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- . / Foreword 

The National Longitudinal Study of the Hi^ School Qass of 
1972 is a 'large-scale, long-term survey effort supporftd primarily by 
the National Center for Education Statistics (NCES), Office of the 
Assistant Secretary for Edi*cation in the Department of Health, 
Education, and Welfare (DHEl^)! Tlie primary purpoafe of this effort 
is to provide statistics on a national sample of studentt as they move 
out of the American high school system into the critical y^afs of 
' early adulthood. The bas0-year survey*data, collected by the Educa- 
^tional Testing Service, have b^n» integrated with the. first and second 
followHip survey data by the Research Triangle Institute (RTI). RTI 
-has processed the -data and is presenting major findings in a series of 

* reports, each with a cefntral theme. This report is one of the series 
and contains empirical infor^ia^on 'about the reliability of selected 
NLS Second FoUow-Up Questiormake items and scales, apd discusses ' 
reliability and validity of NLS typ^uestiormaires and survey re- , 
search in general. This report evaluat^ reliability and validity as a • 
function of question cha^cteristics, respondent characteristics, and 

* data collection procedures. 

Many people and organizations have ccMitrihtited generously %o 
the base-year and foUow-up surveys, and their efforts are sincerely 
appreciated. \ye are* especially grateful to the moudands of anony- 
mous sample members who have participated in the surveys, without 
whose cooperation this continuing study \yt)uld .nqt have been 
possible. 
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•L INTRODUCTION 



This report has two n\ajor purposes: a 
,.^View of the bterature pn tl^ validity and * 
Pliability of survey data; tnd an analysis of 
' the reliability of selected questions in the 
- -Second FoUow-Up questionnaire of the Na- 
tional Longitudinal Survey of the High School 
tlass of 1972 (NLS). The key .part of the 
reljiability study is an empirical analysis* of 
selected NLS items* on a sample of NLS 
respondents. The reliability study includes an 
Valuation of .test-retest reliability as a func- 
tion of cUta collection procedures (mail-in or 
personal interview), item characteristics 
(response ' format, item content, and item 
length^, r e s p o ndent ch'aracteristics ( sex , 
ethnicity, SES, and ability) and the inter- 
section of *these diverse factors. The general 
purpose of the reliability study is to provide ' 
information on the quality of NLS question- 
naire data; however, a more general discussion 
of the findings will mclude giiicMinesJor ana- 
lyzing survey data and for improving the 
quality of data in survey studies. 

•While an empirical analysis of validity ' 
would have been desirable, such a study was 
not \indertaken because of concernsl about 
federal policies an^^ pending legislation con- 
cerning informed consent and the invasion of 



• privacy. 5ome concern also existed about the 
^ possibility of respondent attrition in reaction^ 

to a validity check. In lieu; of in empirical 
analysis of validity, kTI and NCES jointly 
agreed to an Investigation of validity based on 
, a* literature review focusiiig on NLS types of 
items. This investigation, like' the reliability 
study, considers data coUeotion* procedures, 
item charlfcteristics, respondent characteris- 
tics and their interactibns. * - \^ 

This report is divided into . four major 
sections. The first section, "A Capsule View 
- of the National Longitudinal StudV of the . 

• High School Class of 1972," briefly sum- * 
marizes the purpose of NLS, the sample 
design, ^nd characteristics oi the basic longi- 
tudinal questionna^es. The second major 

^ section provides a compreh^ive review ot 
validity and reliability for NLS type questions 
and respondents. The third'section presents a 
detailed study of the feliability of a sample of 
Second FoUow-Up questionnaire items on a 
satnple of NLS respoildents. The final section 
ir)tegrates' the conclusions of the review , and 
reliability study results and discusses the 
impJications of these results for survey 
research. 
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11. A CAPSULE VmW OF THE NATlONAt LONQITUDInAiNsTUDY 
. / QFTHEHIGH SCHOOL CLASS OF 1972 



The National Lon^tudinjal Study of the 
ffigh School Class ^ of 1972| {NL§) may be 
.briefly characterized as a '»wide-ranging longi- 
tudinal ^^estionnaire' survey 6n a . highly, 
heterogeneous sample. N^S is sponsored 
primarily l)y thenJnited States Department of 
Health Education, and Welfare and is admin- 
istered by the National Center for Education 
Statistics (NOES). Briefly ,;th« overall purpose 
of the NLS survey ' is to iletermin'e. what 
happens to young ad^ults after they leave high 
school~«s measured by their experiences,- 
plans, aspi^tions, and attitudes at various 
points in tlnie. This*, information is deemed" 
^sential for the review and reformulation of 
tederal policies and programs desi^j^d to 
enhance educational opportunity and achieve- 
.ment and to upgrade^ occupaffional attainment 



and career outcomes. 



The m^or vehicle for obtaining data has 
been mail-a^iministered questionnaires but- 
tressed and Augmented by telephone or 
personal interviews as required. But othe^ 
inforh^ion ha;^ also been coUected. The iii 
strum^nts thus far include: high school 
records and high school descriptive informa- 
tion for every student Hind high school com- 
prising the satople. Also, a counselor question- 
naire was administered to at l^ast one coun- 
selor from every participating high school. 
Most students in the original base-year sample 
were administered \ test battery covering a 
range of- verbal andVonverbal ability meas- 
ures; this battery wak devised and admin- 
istered by the Educational Testing Service.* 
Each student has been ^ministered four 
questionnaires so far: a Base- Year question^ 
naire administered jduring the spring of 1972, 
the First FoUow-Up questionnaire mailed in 
October of 1973, a Second FoUow-Up gues- 
tio|maii:p mailpd in October of 1974, and a 
Third FoUow-Up questionnaire mailed in 
• (October 1976. A Fourth Follow.-Up is tenta- 
tively planned. for October 1979. Iri addition, 
a replication study of the high school class of 
1&80 is on the drayg^ing boards. 

' Most questions (new" ones have been , 
added, from tim€ to time) have been field- 
tested and different formats for questions and 
questionnaires have been, evaluated on a 
900-memb^ sample of students from the high 



school class of ld7l. In this way^ problems 
with fojjnatting. Wording, and item redun- 
r dancy have been worked out on an independ- 
*ent sample of-pei;sons before arriving at the 
final instrument.. * 

A. Sample Design ^ 

The sample design is a deeply^ stratified 
two-stage probability sample with schools as • 
first-stage sampling units and students within 
schools as second-stage units. The population . 
sampled^onsisted of all 1972 twelfth graders 
enrolled in public:, private, and church affili- 
ated schools in the fifty states and District of 
Columbia. A variety of strata were used for 
school selection: * - 

1-. Type of contrdl, 

2. Geographic region, # ' 

3. School size, » 

. 4. Percent minority enrollment, 

5. Inconje level of community, 

6. Degree of uri}anization, and 

7. Proximity to institutions of higher 
learning. ' — ~ - 

In order to increase the numbers of dis- 
advantaged students in the sample, schools 
located in low income areas and schc^ols with 
high proportioj^^f jninority groUp enrolf- 
ments were sampled at approximately twic^\ 
the sample rate used for the remaining 
schools. A variety of other considerations 
were also empldyed, and are outlined in detail 
Elsewhere (WESTAT^ 1972). 

The sample even);ually mvolved about 
1,300 priraa^ and back-up s^jhocls and over 
23^000 students. TjLis breaks down for Base- 
Year questionnaire*^nto: 1,070 participating 
scmools with 19,144 respondents, and )a. 
resurvey during\the faU olf 1973 provided data 
from about 4445(]^ students from 257 schools 
declining to participate in spring 1972. The 
resurvey was pn^ertakem to complete the 
basic sample but some critical data are lacking 
on thesa respondents: viz, ability, locus o^ 
control, self-esteem; that is, all data which are;^ 
"soft"— i.e., psychoFogical in nature—were not 
obtained. , ' ^ ' ' 
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Gt tile 22,654 students ihailed Krst 
FoUow-Up q(Uestionnaires, a tom o{ 21,350 
respondents either returned the questionnaire 
6r were personally interviewed (by the Bureay^ 

* of the Census), yieldiing the high * return :^te 
of 94.2 percent The Second FolloW-Up 
survey produced an even better retumj^—^ 
20,876 studeots or 94.6 percent of the mail-^ 
out at that time. Ov& 90 Mrcent of the Base- 

Jfear survey respondents Yme been retained in 
the* study through two follow-ups. 



Questionndire Characteristics 

Four kinds of instruments have been used 
in the NLS survey: school and* coungel8r 
"^que^tji onnaires detailing ftigh school and 
counseling* characteristics; a school record 
information form filled in by the hij^ school 
for eaclfstudent in tne sample; an ability 
battery a3?hinistered j/o the students surveyed 
during their seniop yeal* in high school; and 
self-report student questionnaires which 
provide the longitudinal data/ Si^ce this 
report focijses pnly on the longitudinal ques- 
tionnaires, further discussion ff the other 
instruments will notice undertaken. The basic ^ 
longitudmal questionnaires (administered in 
the spring of 1972, fall of 1973, faU'of 1974, 
and the faH of 1976) are* s^lf-repiort instru- 
ments including complex skip patterns and a 
variety of formats (simple fiif-ins, bii;^ 
choicc^j- ^ ratings 6f subjective importance, 
m(tltip^9t endorsement among fixed options. 
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single endorsement amon^ fi^ed qptions, etd). 
In a^l^ition to a variety of item character- 
-{stics,^ the * method ofSydata , collection also 
varidd. T4iree basic data collection method^ 
have been used: self-administration of the 
questionnaire ^(handled entii'ely through the 
mail); self-administration followed up by tele- 
phone interviews tt> collect critical missing 
data; ' and- personal interviews the U.S. 
Census Bureau (First 'Follow-Up) and by RTI 
field staff (Second and Third Follow-Ups) for 
respondents who failed to mail in their ques- 
tionnaires by 9^ specified /date. This ove'ralj 
data collection strategy has produced a 
remarkably high return ralte, fcut clearly the 
quality of data could vary as a function of 
mode of daj;a collection, ^ ^ 

A large variety pf topi cs are covered in the 
NLS qu^lJonnaires. Major sections of trhe 
questipnnaiifes are devoted to background 

. ^formation, psychological and social factors, 
education, work, military, and homemaking. 
Eack of the sections on educatidi^ work, 

. military, and homemaking includes questions 
on activities, plans, and attitudes and 
opinions. The psychological and sbciological 
topics include consume^ and political' atti- 
tudes arid activities, career and life goals, and 
attit^udes about the self. In correspondence 
wilh the range of topidis and restrictions on 
questionnaire length, many of the constructs 
cannot be pursued- in depth, thus the instru- 
ments may be typified as broad band and low 
fidelity (Cronbac^,a97b). 
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At»EVl£WOF^URVEYdATA 

Intrpduction . ' * ^ 

• As indicated in the capsule view of the 
NLS' survey, the basic longitudinal question^ 
naires cover a broad domain of , question 
formats^ and content. Question type&«* 
include: factual and subjective ^information, 
open-ended and restricted choice tormatsT and \ 
fating scales. The time orientation of the 
questions^ varies from retrospective through 
prospective. Question content includes work, 
educational, military, and homemaking 
activities, ' opinions and plans; family and 
financial status; and a variety of opinion ahd 
attitude questions^ covering consumer 
political arenas, life and career goals, and 
ings about tl)e sdf . Tfuis7whil^ the NLS i 
tionnaires provide a rich, variety of infc 
tion, the scope of the material covered in con- 
junction with the variety o*f data coUectiorj^ 
procedures and heterogeneity of respondents/ 
^lus the novelty or relative novdty of many 
questions, prohibit^ an in-depth literature 
'review of validity and reliability. This review 
of survey question validity and reliability will 
focus on NLS type data collection proce- 
dures, questionsyi^and respondents. However,'^ 
$ince it is unlikely that other studies would 
even approach similarity on >all three dimen- 
sions, the literature- included in ^this review 
wi]][^be selected for maximum similarity and 
kiformation/on any one ok two of these three , 
dimension^ The review will iocus primarily 
on validity dnc} secondarily on reliability as 
they relate tc^ 4hree major sojurces of 
variation: 

w \ 

1. Variation associated with content and 
item ch^acteristics; 

2.. Variation associated with the mode of , 
datajcoDfection (maiUpi questionnaires 
versus interview obtained data); and, ^ 

3. Variatic^n associated wi^^h respondent 
^characteristics. 

In addition to the problems of obtaining 
items and respondents maximally similar to 
NLS items and respondents, otHei' proble 
should, be noted. One major problem 
reviewing the literature is the variety of proce- 
dures used to obtain information on v^idity 
and reliability and the variety of indices usec^ 
to summarize the results. While this was not 



VALIDITY AND RELIABILITY 

unanticl^ted because of 1[he variety of- 
research disaplioes si^yeyedL it does pose 
proble^ for equating findings from various 
. studies. For Example, oQe researcher nught 
conclude on the basis of perbent. agreement. * 
that /a particular item is highly valid, while 
another researcher using a contingency or 
correlation coefficient might concfude that 
the same item was relatively isvalid. Short of 
soliciting' the, original data and recomputing 
the statistics, there is no way by whj$h such 
discrepancies could be resolved. We have,^ 
however, chos^ to emphasize t^ose studies 
which clearly specify the data collection 
procedures and which use tiA most appro- 
priate (for that dataaet) statistical indices. 

^ In additidn^, although the classical distinc- 
tion between validity and reliali^y is con- 
ceptually appealing, the distinction quickly 
blurs urfder a variety of conditions. We have 
attempted to maintain this distinction by 
referring to validity only whm the study com- 
pares a responcient's* results lo data oBlained 
'from a factual or independent source of 
jpformation. The exception to this is the brief 
review of the valic^ty of psychological vari- , 
ables which generally require a construct 
validation approach. Reliability is used to * 
refer to results obtfcdned from internal consist- - 
ency analyses (e.g., coefficient alpha) or 
test-retest procedures on the same respond- 
ents. We have generally not included studies 
which relate response distributions based on 
independent samples of respondents. 
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Two unpublished studies have been done 
on selected NL$ data: Ectjemacht (1973) 
carriM out a limited -study of 4he reliability 
and validity of selected NLS Base-Year Stu- 

iSent Questionnaire items; and" LycAs and 
Moore (in press). invei?tigated the reliability of 
selected retrosj^ective Bas^Yjtf dat^i col- 
lected on the NLS Firflt/ollo^f|>,Qiiestion- 

, naire. The jesearch of Ectern^i^ included a 
test-i«test reliability substudy (siil^ilar 9i 
design to the reliability study covered in this 
report) and a proxy validity !^u|}$tudy. While 
these two substudies had^ potential of 

"providing critical inform&t|^/pn the quality 
of NLS data, the analyses m^xk limited to 



investigating jiet and gross difference rates 
(Hansen* Ttonvitz^,' and Pritzker, 1964) for 
items for tne entire subsample and for males 
and fenjales separately. Por thfe reliability 
substudy, Ectertiachl concluded that the item 
reliabilitfes were generally rather low- and 
fecommended that* composites be formed to 
improve data quality.^ The validity substiAiy . 
was reported as being m^hod^logically com- / 
promised and the responsfetsju^^ere^suffixaer^^ 
biased to negate validity jCstimafion. In both 
substudies by JEcternacht, respondent 
characteristics (other than se3c)^item content,^ 
and data collection procedures, were not 
investigated. Because of these and other limi- 
tations these two substudies are not giyen 
further considerations 

The study by Lyons and Moore (ih press) 
also disregarded respondent characteristics 
and data collection procedures. More impor- 
tantly, the study focused on the re^ospective 
reliability of a. selected set of items in an 
attempt to specify the degree^ to which retro- 
spectively collected data coulfl be taken as a 
valid indicator of i*n earlier status. In this 
regard, their results arc not particularly rele- 
vant to the purpose of this review. . 

Among others, van Es and , Wilkening 
(1970) assessed the reliability of a standard- 
ized intecYiew schedule focusing on item 
characteristics. Although the major purpose 
of this study was a comparison erf Brazilian 
and United States ciata, the results of the U/S. 
data seem particularly germane. In general, 
response, reliability variedjStrongly with item 
content and temporal focus. The most stable 
it^s were demographic (70 percent were in ^ 
tt^ ."80-. 99 reliability range); next most stable 
were variables dealing with factually oriented^ 
current behaviors (64 percent in the .*0-.99 ^ 
range); third most reliable were variables deal- ' 
ing with factually oriented past behaviors (42 
percent in the .B0-.99 range); and least stable 
were' evjJuations or subjectively oriented 
items (only 20 percent were in the .80-. 99 
range). . - • ^ 

A^iin' (1965) obtained similar r€*sults from 
a questipniiaire' test-retest over a six-week 
^terval leased on 107 college students. Ques- 
tions which had little^ambiguity and dealt 
with important accomprishment5^(e.g., elected 
student president) had high rates of stability 
(95-100 percent). Achievements of a more 



ambiguous or less important state had slightly 
loweragreem^t rates (90-100 percent). Ques- 
tions dealing with fatherV occupation, high 
school grades, and nonacajiemic^complish- 
ments were sulDject to greater variability 
(74-92 percent agreement). Attitudinal itenis 
or ^future plans produced even lower agree- 
ment rates.(60-79 percent agreement). 

The accuracy of survey .data shows similar 
variation. Walsh (1967, 1968) investigated the 
accuracy of self report on grades, major area 
of study, number of semester hours com- 
pleted and high school status (grades, tpk ih 
class, etc.). Using only 45 st^entS from thtee 
differe;nt residence halls, Walsh also attempted 
to compare accuracy as a function of data 
coUection procedure ' (questiorjriaire, mter- 
vLe V^ or biographical inventory). No 
differences we detected among the data- 
collectipn pr^edures; however, a^curjcy of 
infcMTtmition did vary with content. The most; f 
accur^ information was for number .of 
classes dropped andj number of courses in 
wh%h a D or failing grade »was obtamed 
(80-100 percent). Least accurate were self 
reports on cumulative or recent gipde point 
average (50-'80 percent) aijd retrospective 
reports of high school. grades and class rank 
(51-53 percent). 

A comprehensive study on validity and 
reliability covering items similar in scope to 
, the NLS questionnaires was carried out by 
Boruch and Creager (1972). The basic study 
involved a two-w^^k test-retest by 203 college 
freshmen on ' questions dealing with high 
school experiences and activities, academicr 
and career plans, life gdals^ "and atti^des * 

^towards various politicfal aftd academic issues. 
In addition, accuracy of grades and age was* 

» evaluated oh 4,415 respondents. ,^ 

Because of the similarity Of many of their • 
qu^sti^s to the NLS questions, reliability 
coefficients of selected vjirftibles are reported 
in detail in Tables 1-3 based on tables pre- 
sented by Bpruch and Creager. 

In general, inability of demographic 
characteristics, family background variables 
and high schbol performance was high (reli- 
abilities were generally Jbove .95). Reliability 
for items dealing with financial support and 
concerns about financial support in college 
v^re somewhat, lower (.85-. 90). The items 



. T^W R€TESTRELIAB!UTttS*FijRITt« V . 
ANOCOai^6EAOMiSSIoiiS* ^v. 



Itlliability (c) 



Fat w*! Education \ i9 

Moi bar's Edbcitton ' ^^ 37 

Est mated Parantiflyitot?^ - ^ ^ 3i 

Coiipam A^o)it |inaficing College Education ^ ^ 

Aviiraga High School Grade ' ^ ^9 

\ Rank In High School Jif 

flumberof^ApplicationstoDther Colleges \ ^8 

Niimber of Acceptances by Other Colt^ * ^7 

Oirance of College From Home ^7 



^asQd on Boruch and C^ager, t972. 



"^tjieir retrospective data wfere abouit as reGable 
as tl\eir demographic data/ The rel^itively 
Ihort^'fesf-reilBst interval of two weeks could 
account IBiis difference as could other 
factors. (^. ^e^ility lefrUlsi the respohd- 
ents,' or better 

In thei^alidi?: 
Boruch and Creagejc!^ 




:!^^study). . 

on of the study, 
Lve 4,415 freshmpn' 



questionnaires during the fall of 1966 -and ' 
summer of* 1967' (mail questioritifaire). Tlie * 
(Si^ewon* data against ^hich th§ validijty of -Y, 
grades and' age was assessed were obtained 
from college fegistrar^, v. . ^ 

The overall correlation between self- 
rep^9rted and registrar-reported gades was. 8^ 
aiKf did not vary with the respondent's sex. 
Validity did however vary with grade level. 
The reports j^f students who .actually per - 
formed af the A/A+ level were most accurate, 
While students in th^ 'B, B~, md C+. stirg^ta 
were least accu^art»^vNo major variation in age 



M|a2 ^ 

TE9f RETEST RELIABILITIES FOR FOUR 
BEfORTED SOUltCES OF FINANCIAL SUPPORT 
DURING FRESHMAN YEAR* 



-/ . 



Source of Finaiictel Support 
Ouring Freshmaii Year^ 



RelMbilit^^r) 



Personal Seytngs or Employment 
Aid From Parents or Family 
Repayable Loan 
.ScholarshTp/Grant/Other Gift 




•For each source, the respondent wee asked to che, 
whether it was major (coded 3), mmor (coded 2), or not a 
source (coded 1). Based on Boruch and Creager, 1972. 



which dealt more with subjective judgments 
or opiiiions were much low^r (median for 63 
te^t-retest * correlations of .74^in Tables 14 
through 15 of BorucHVand Creager's report; 
ran^^ .41. to .89). Retrospective reports of. 
hi^ school achievements were highly reliable 
(range .88 to 1.00). . ' 

Whil^ Boruch ancf^reager's results gen- 
erally ^support the* findings previously 
reported, several differences are worth, 
noting: the reliability coefficients they^'qb- 
tainea were generally higher than others and 



Table 3 

TESTRETEST BEIIAAlITIES FOR 
REPORTED OBJECTIVE'' 



Obpctivei^ 



Being Accomplished in a 
Performing Art 

Being an Authority igt^Field * 
Obtaining Recognitiori From Peers 
Influencing the Political Structure 
Raising a Family ^ 
Having an Active Social Life ; 
Having Friends Different From Self ^ 
Being an Expert in Finance and 
1 Conrmerca 

leaving Administrative Responsibility^ 
for Work of Othea 
Being Very Well-off FinancTalfy 
.Helping Otfters in Difficulty 
.Be'coming a Community Leader 
Contributing to a Scientific Theory ^ 
Writing Original Wo rjcs 
Not Biling Obligated to People 
CreatingWorksof Art 
Keeping Up With Political Affairs . 
Succeeding in Ovim Business 
Developing a Philosophy of Ufa 



ReliibHi^ (r) 



.78 
.73 
.68 

.72 

.'.71 

-70 
\74 

:66 

ii 

.Gi 

-74 
.79 
.80 
.71 
^1 

£7 



, * Bajwd on Boruch and Creager,;l972. 

t A/terhativat and scoring key, ^ptsemial - 4; very ir^>portant 
- 3, somewHat important * 2; not important « 1 . ' 



^accuracy as a function^ of ^age* was apparent^ 
Ixit me^' tended to<be more^acourate (.91) 
than women (.85) irb reporting age. 

. Alttvough '^me .dilferences in validity 
were associate with'race, Boruch^nd Crciger 
felt that the number of blacks includect 



in 




their sai^iple (6.4 men' an^ 86 women) prohib- * 
ited aj\ accurate ^imate of differential 
respqnding as a function of grade level. *No 
di^erenees were noted iji reporting age as a, 
<rfuncti<>p of race. , . * 

> . ^pi^g da|a firom a national longitudinals 1 
sulryey, Borus^ and NesteJ (1971; 1973)' 
sampled 913 fatber-sbn pairs in order to assess , 
the vl]idity of the son's reports of his father's 
edu|»tion. A variety of SES and demographic 
vfuriitbles ,wcre included to determine their • 
V^tionship to the accuracy of reporting. , 

^g both ^iljl1va:pate and multivari?!^ 
jqu^s, Borus and Nestel reached'j^the 
fbllowing conclusion^*' " 

1. There are major differeni^/ in 
Accuracy las a function of ^agij (6§-per- 
} cent 'of tl|p^,^rtiite fath|pfe)n pairs 
»roduce^ ^depicid data fe'bmpar^ to* 
' * 37 percent ol*biaidk father-son pairs); 

' 2. Father-son pair^Jj;pm households with, ^ 
- '.10 or more family members are less 
Hkely to be. in agreement than father- 
son p.aits fr^^^^aller households; ^ 

Sons, who ^Aport , fathers as "white 
collar wori^" are more likely to be 
in agreenaent "with their fathp^rs than 
gons. who say their , fathers are in 
service occupations;" 



3. 

4 



* ' I : 

4, Males'* currently in «chdQl are niCMre 
likely to agjriee with their fathers than ; 
males not currently enrolled. ^ , 

Kerckhoff, Mason, and Poss (1973) inves- . 
tigated the validity of family* S(>cial stahis ^ 
' using boys'^questionnaire reports of parental 
^ educational level and father's occupation. 
Criterion data "were provided by interviews 
with the parents. The results indicated a * 
moderately high validity level (s^-'^able 4) 
for reports of parents' education and father's ^ 
occupation/al status. The validity of the son's 
report of father^^AHBHBS^ ^tus did, , 
hoMv^^r. vajry^''^^i^^^^^aMites provided 
more valk^ta thBWiPRsi 1 - ^ . ' 

Jh a similar stuC^y on the validity of. • 
^ reports on parental education and occupation, 
Cohen and'Orum (1972) found lower con-^, 
sensus for black parent*child pairs than white 
parent-child pairs cm both occupational and 
' educational reports (Tat^ 5). ^ ^ 

Differences in the findings of Uiese twq , 
studies codld, of course^^be due to a variety of • 
. factors (index of correlation, response cate- ^ 
gorigfe, inclusion of both males' and females in ^ 
lh4ii^ohen and Oirum ^study^ and* a larger 
nui^ber pf subjects in the Cohen and Orum 
study)* any case,' the diredtion of the 
results In both studies is consistent: . for tliese 
-variables white parent-child pairs were more 
in agreement than b||pk parent-child pairs. 

In the same, study (Cohen and Orum, 
1^^72) validity was also associated with 
. resfJondent characteristics of child's sex,^ 
child^s ^ge^ ahd child's school (urban middle- 
class ^pjiva"!^ school versus inner-city lower 



VALIDITY INDICES* BY R^CEFOR 12th GRADERS' 
REPORTS OF PAAENTAl EDUCATION AND 
fATHEl'S OCCUPATIONAL STATUS 



VniiMa 




'WlHtn(r) 


. J ■ - — - 

MoTfitr't Educatipn 


V 

.83 . 


M - 


Fffthtr't Educititfn 


.81 


M 


FsthtrTDccupction 


\ .74 


\93 



*Oata from Ktrckhoff, Mason, iind Pott, 1973. 



GAMMA CORRELATIONS BEtWeEM PAREUT AND 
(dflLO RESPONSES FOR REPORTS ON > 
PARENTAt ^BfUCATION AND OCCUPATIOiNt ^ 





"m ' ^ 

BladaUj 

* > 


WilitM (r) 


Mothtr*! I^ducftion 


'.71. 




Fathtr*! Educition 


.76 


31 


MothtKi OcGupttion 




.74 * 


Fathtr't Otcupttion 




M 



* BaMd on'dita from Coh«n and Orum, 19>2^ 



elate predominanjpy black school versus 
to workkg clas»^p]^ominantly whiW 
Among thc^ .groupings there wer^ no 
.ent differeno^ ^cross^^/fot^'^g^lf/ 
ifres: no gwip, ^as qonsfetentj:^ 
inferior ilthoQ^ groupijiid^^c^M v ^ 

0, ,^so. investigating stu^ej^^ei^prts _ 

'li^ta^,^ Kyaser an(i !B^5l^ers <19i?) 
cdH^fted , student data foi each of tf^e 
succ^j^e years and an indeisfeftdent si^rvey of 
boW ;^ar€nt§. They concluded" that student 
repgjrts were stable over time with parentil 
edlication being most reliable/ (.96^for 

^%iothers, .97'for fathers) and father's oc6upa- 
tion and iiicome least reliable (.79 if or occupa- 
tion and ^.56 for income). The validities, 

corrected for unreliability, wei^ only mod- 
erate. Comparet^ to the concurrent mother's 
report^ validity of mother's educatioji was 
.72, father's educatipn^ was .83, and father's 
occupation was .86. Compared to . the con- 
current father's report, the validity of father's 
education was .70, father's occupation was^ 
.74, and father's income was dffly .21. Based 
on the validity findings, Kyaser and Sununers 
concluded that student reports should be 
utilized with sojne bdution, and, where pos- 
sible, direct pleasures' of parental SES should 
be used. js. 

IiMdT investigation of retroq)ective report- 
ing of own £md others' occupational status, 
Featherman and Hauser (1973) relied on data' 
collected from a "variety of sources. Based 
strictly on adults' reports (age 19 and over) 
they concluded that retrospective reporting of 
own occupational status is robust over a five- 
year period; however, proxy retrospective 
reports are apparently subject to (memory) 
decay. 

Although Feirtnerman and Hauser (1973) 
seem guardedly optimistic about thraccuracy 
of retro^ective reporting of S£S indices, one 
of the sources on which their conclusion^ are 
based (Walsh and BurckHoldt, 1970) reached 
less optimistic conclusions. They concluded: 

1. There was a relatively high rate of 
response error associated with the 
retrospectively reported data on worx > 
status and occupation five years ago. 
Only 57 p|^rcent of tl^e total respond- 
ents accujrately reported both sets of. * 
information. 




substantial difference was noted 
between- .workers and nonwork^rs in- 
the. accuracy of reporting this infor- 
mation. Approximately 70 percent of 
the nonworkerjs correctly reported 
their work status five years ago, 
whereas ' only 48 percent of the- 
workers • accurately answered the 
retrospective questions. 

3. Errors in reporting work status five 
years ago was an important factor in 
the overall level of error. The failure 
to report leaving Worked five years ago 
accounted .for <>njE?-tJ|ird of the errors 
made by persons whp' .Worked in 
1963. This, of course,; resulted'^ in 
corresponding loss in' the data on 
occupation five years igo. 

4. The. accuracy rates varied among the 
teajoF- occupat^on^ groups. As ex- 
i)ected, the accuracy rates were higher 

\ft)r the more skilled occupation 
groups such as professionals and 
managers than f^r the less ^killed 
groups suc^ as iarm and nonfarm 
laborers. 

^5. Age was a determining factor in the 
accuracy of Reporting this informa? 
tion. Persons in the middle age 
group— 30 to 64 years old^iad a sifipi- 
ficantly higher quality oX response 
than the othertwo age groups* con- 
sidered (1^ «r29 years old and 65 
^ yeaxp old and over). 

6. The quality 0f the retrosn^active data 
for occupationally mobile^rsons was 
substantiaUy Igwer than that for other 
worker^. 

7 . The accuracy ' the retrospective 
occupation responds, however, was 
only aboujt 7 to 9 percentage pointy 
lower than the accuracy qt reporting 
current occlipation in the 1960 
Census. This is due partially to th^ 
fact that the nonmobile i^orkers make 
up the vast majority of respondents 
and the error rate for nonmobile 

9 * workers is considerably lower than 
that for mobile workers. ^ 

Keating, Peterson, and Stone (1950) 
compared interj^w reports of weekly wa^es 



to employer's wage reports. They found 
approximately equal validity correlationp^for 
^ males T-90) and females* (.93 J. Duration of 
employment using the same procedure pro- 
duced equally high validity correlations for 
both ftiales and females ( .^8^:^ 

Bonis (1966] in a survey of validity 
4^tudies based on 1950 census data versus 
other sources concluded that comparisons of 
census distributions versus other source dis* 
'"{nbutions showed only minor differences in 
median earnings. In a moxe direct study of 
validity, comparing interview data to employ- 
er^ records, 6orus(1966)ffound a .95 correla- 
tion for earnings. A more detailed analysis 
based on regression techniques showed, how- 
^ ever, that the discrepancies between self 
* report ahd employer's repprt were related to 
respondent Characteristics. In particular, 
women- compared to m^|underreported ea] 
ings.and underreporting varied directly wit 
amou/it earned, inversely with age, and 
inversely with ^ucation. Borus also found 
that underreporting decreased a^- familiarity 
with the interviewer increased. In a second 
regressipiT analysis, Borus related response 
error (o characteristics of the respondent's 
jobs, ^e additional findings of .this analysis, 
were that errors in reporting were ^ater for 
new employees arid for parVtime employees. 

B^ed on these analyses, Borus concluded 
that l^eBponse bias exists and is significantly 
related to respondent characteristics. Thus 
earnings statVtics not only ihvplve sampling 
error, they also involve response error. 

Sihce the error in Boi*us's study emerged 
as bias and not strictly random deviations, the 
compiarison of independent distributions 
aggregated over dif^rent kinds of respondents 
could obscure this error; yet the majority of 
studies investigating item forjiifatting and the 
data collection procedures are abased on'^just 
this approach (Cannell and Fowler, 1963). 
Desp'ite the problem of artifactually obscuring 
differences, Cannell and Fowler* note that, 
compStrisons of distributions ^generated by 
questionnaire .versus interview ||t>cedures do 
sliow differences. The most Relevant findings 
Ve: L 

1. There are few differences between the 
procedures but those that occur are' 
•thought to arjtse from the respondent's 
desire to present a socially desirable or 
' rnonthrpatening self-image,"^ 




2. When questions are ambiguous, the 
presence of an interviewer results in 

. fewer noni^Onses; * ^ 

3. People witti a high education and 
^ income are more likely to cooperate 

in ^ mail survey ; and 

4. People who cpnsult records^ tend to 
report more accurately. 

i 

Cannon and Fowler also undertook their 
own study of interview versus questionnaire 
procedures on hospitalization variables. Using 
462 intervieiys Imd 465 questionnaires solici^ 
ing information bn length of staj?^ month of 
discharge, diagnosis,' type of sui^ery (if any), 
and whether or not surgery was perfonfied, 
they concluded that (1) the ^self '^pumerative^ 
procedure is more accurate when Records are 
available (i.e., length pf sftiy and month of 
discharge); (2) anonymity rather than inter- 
viewer presence or absence is^the relevant Vari- 
able iif^ the finding that self-enumerative prp- 
ui:es tend to ^educe^social desirability; (3) 
tion of the respondent is more impdr- 
tant/. in N^he interview than m the self- 
erative procediure; (4) motivation is an 
important fa^^toi", particularly in the questiwi- 
naire procedure, witTT education seemingly 
only impOTtant within the **better motivated" 
group, of r^sportdents; and (5) given minimal 
interest on th^ part of many resporidents, 
they recommend that questionnaires be self- 
explanatorvandj as short as possible. 

The Mowei review has been primarily 
focused (on the validity and reliability of 
factually, oriented data; the NLS question- 
^'^airefdo, however, involVe A number of atti- 
tude and opimon questions. Chief among 
these are selfn^steem, locus of control and 
work, and co|ttmunity^ and family orienta- 
tions. These sc^es Cannot,^^3ff^ourse, be veri- 
fied in the same way .that income, grades, or 
other factually based data can be • veri- 
fied: there simply are no objective measured 
of self-esteem^ locus of control,* etc. To 
further complicate matters, the majority of 
attitydin^ or p^chological scales are novel to 
I^S and no literature can be surveyed to 
weave a construct validity net. ' ' ^ 

The best approximation to the construct 
validity of these ^cales is to be found itt 
Conger, Peng, 'aM Dunteman (1976) using 
precisely these scales on NLS respondents. In 
tjiis report, the variable of self-esteem leased 



on iCosenberg's self-esteem scale (Rosenberg, 
1965) did not emerge as a^efStenTvanable for 
discriminating among demographic groups; 
however, the differences whielfi did emerge 

♦were generally consistent with 'previous an'd 
ticipated differences. 

The loCus-bf-control ^ale bonrowed from- 
' Coleman,^ Campbell, Hobson/ Mcfartland, 
Mood, Weinfield; and York (1966), while 
deviating in content and form from other 
locus of control scales— for exanpple. Ratter's 
scale (Rotter, 1966) and^ the James-Phafes* 
scale (James, 1957)-generaliy showed similar 
patterns of between-group discrmiinatron. In 
particular, wfiites were more internal than- 
•nonwhTles^ and^low SE^ persons W^e more 
external than middle or high SES persons. 
The strongest relationship was withyability, a 
finding , that, at first glance, was not entirely 
consistent with the literaturef however, as 
*C)onger, Peng, and Dunteman noted, thisrfind^* 
ing actually integrated previous discrepancies 
in the literature. While no possibility existed 
for mvestigatmg sources of contamination of t 
bias m the self report of locus of_control, t^o 
•major sources' of bias have been investigated 
for other locus-of-control scales. In particular, 
anxiety is purported to have an unduly high 
correlation with externality fcf.* Butterfield, 
1964) but socially desir^ble^ responding is 
thought to play^at most, a minor ral& 
(Lefcourt, 1966) To th^xtent that -the NLS- 
jlocus-of -control scale is similar to these ather 
'scales, one could anticipate that th^se-^sources 
of bias operate in the NLS data m a similar 
way. 

The life goal orientation cwnposites gen- 
erally showed Weak but inte*rpretable*reLlation- 
ships. Since no pnor literature exists on these 
scales, and^smc^they had fairly modest or 
low mtefnal cpns^ency reliabilities, it is^ 
difficul/to formulate a statement about their 
construi^t validity. 

Reliability of tbe NLS self-esrteem, locus- 
of-control, and life ^oal scales ha^been 
obtained by both intemaJ coh^tstency 
methods and test-re^st methpds(s€e Chapter 
III). Overall, £he reliability ,of those short 
(three- or four-item) psychological scales is 
reasonable via either approach for self-esteem 
(a = .66, r= .66), and test-retesft reliability is • 
generally high for locus of control (r=.71) 
and work (r-= .68), community fr = .67) and 



famUy (r= .GSi' life goais. The internal con- 
sisteacies, however, of all but the self-esteem 
scale are generally low: locus of control 
(a - .56); work goals, (a = .53); community 
"^^als (a = .44); and fartily goals (a = .30). 
The reliability l^vel,. or course, puts con- 
&traints on the ma^^imum values for the valid- 
ity coefficients. 

C. Conclusions 

In terms of the|three sources of variation 
outlined in the introduction, i.e., item, data 
collection, and respondent characteristics, the 
following represent the general conclusions 
which can b^^awn from this revie^: 

1- Variability of responses is very much 
affected ^by the **content" of the 
ite^s. Content in this, instance refers 
f ^ to'^the dimension of objectivity- 
subjectivity. Demographic character- 
istics and factual information about 
,present behavior *yield the highest 
validity (and reliability) coefficients, 
respectively. Factual Information on 
past behavior and evaluative or judg- 
mental behavior yields the least stable- 
data, with the latter representing 
. lowest response stability.^ Further- 
« more, validity of reporti^ of past 
, - behavior may be moderated by the 
''importance of the accomplishment.'' 
* That IS, past. events which have low 
ambiguity and are significant to the 
respondent in terms of accomplish- 
ment, e.g., elected' student president, 
tend to have high rates of validity, 

The reliability of report of future 
events and for goals yields moderate 
to moderately high coefficients (.7d 

^ X K' .8&), in most cases. How'^ver,. as 

one would expect, the^ re por^ are 
affected by the objectivity-^S^HeS-ivK 
^ ^ ty dimension of J^he query. IThose 
future ^ events and/or goals, requiring 
evaluation or judgment may yield co- 

^ • efficients k\ the .50's and .6^47" 

X 2. Variation of response due to data 
collectibji mode can prodijpe a 
Significant effect when one is using 
proxy r^orts and'mixed effects when 
one 11^ ^^l^^^^to an interview versus 
a questio^J^^ method. 

) 1 



Proxy 4^ports by high school age 
children yield reasonably reliable data 
when measi^g |>arental education; 
'however, reliability decreases whdfn 
measuring father's occupation or 
income. Validities for afl SES meas- 
ures were moderate,but the validity of 
income reports ^js particularly low. 
Proxy reports aretfurther affected by 
respondent characteristics. Reliability . 
and validity jwg/ decreased if the 
reqc>ondent is black, is not ^nroUed in 
schoqj' or has Ipw educational attain- 
ment, or has- a blue collar or service 
worker for a father. These char^ctei*- 
istics by no means exhaust the ^ipain 
of variables whictT* affect validity and 
. reliability of re^rting, but do reprer 
sent some of <he major factors. Proxy 
reports of fathes^ ^rrent status on 
some variables, * i.e., education and 
possibly occupation, may be accept- 
able^ for research purposes; however, 
retrospective proxy reports are in gen- 
eral unacceptable. 

J The most detailed study of inter- . 
view versus questionnaire procedures 
yields mixed results. When the 
respondent has records to consult, 
questionnaire procedures produce 



V more acfcdrate results. According to 
Cannell and Fowler (1963)^ education - 
of the ijeqDondent is more important 
the interview procedure than in th^ 
que^onnaire procedure. Motivation 
of the re^ondent comes into play but 

\only within educational groups. On 
the other hand, motivation is more 
important in the-^estionnaire proce- 
dure with education ^tjeeoming a 
factor .within "better^ motivated" 
groups of respondents. There is little 
information on content or respondent 
characteristics by data mode inter- 
. actions. , - 

3. Respondent characteristics play an* 
ubiquitous role in affecting *the vari- 
ability of re^onse, perhaps because 
they encompass such a limitless do- 
main. By and large, wl^te, hi^ly edu- 
cated, wePto-do« employed resfjond* 
ents 'from small families produce the 
most accurate and stable responses. 
So^me studies find males slightly mbre 
reliable and accurate than females, 
^whije others find no sex differences. . 
There ^ exceptions to the conclu- 
sions above, of course, but as a general 
rule they bold. * 
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, IV, A RELIABILITY 

The basic longitudinal questionnaires of 
the KSft study have been described (above) as 
broad in scope and diverse in item charac^r- 
>i8tic8. The review of the available literature 
indicates that the NLS, questionnaire ilems \ 
«hould vary in reliability as a function of item 
content and, to a lessee degree, as a function 
of item formatting. In a similar faishion, the 
divers^ characteristics,of the^LS respondents 
can be- expected to be^ associated with 
differential reliability. In particular, the litera- 
ture review indicates that reliability varies 
with respondent's face and sex/with whites 
and^ males generally being the ifiore rclia^le^ 
Only limited informajtioh has b^n colIe<;t^ki 
on reltab^ty as a function of SE& and ability 
variables; howevdfe, ^he results indicate that 
high ^3 and high ability refi|>ondents £ure ' 
most t«fliable. Studies on data collection 
pupcedui^s da not strictly favor in'tertiew or 
mait-in a^'pr^aches; rather, an interaction 
appeikrs to e^ist between data collection pro- 
cedure^ ^d the respondent's abif ty and SES 
level, and between d^ta collection procedures 
and item content. ^ ; • 

It Woiild^ thus appear that the very factors 
,whicS .make the NLS data base unique and ^ 
' desiAW/(i.e., heterogeneity #of jfontent and 
respon^pt characteristics afid data j:ollection. 
procedure^" designe4 to provide a high return"" 
rate) also introduce th^ possib\lity highly 
^differing data qualitv^as a functi^on of item 
content, respondenticharactenstics, and data 
c'olleition procedure. Interactions among 
these three sources of variability are alsb^ike-* 
ly. /Obviously a study of "these factors woiild 
, provide useful informatron to us^rs of NLS 
' data and to survey roeeauch in general. 

* To 'date, however, only a small amount of 
fffort has been* devoted 'to anvestigatrng the 

^ qtiality of T^S data (Eotemacht, 1973 and 
i.97'4r and Lyons and Mddr?, in press).* In 
the course of irtst|unjerft develppment (via 
field tests on 900 students from the ftigh 
school cl&ss of 1971) decisions about mstru- 
menls have prii^grily focused on question- ^ 
naire format, the recRictioiy of item redun- 
dancy arid the development of com- 
posites: generally,' problems "of 4;^lidity and 

* See Chapter III for a <iiscussion of these 
studies. * ^ ' 
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reliability • have not been investigated. 
Exceptions to this include the determination 
of composite' score intem|d consistency 
indices (coefficient alpha) for certain psycho- 
logical measures (e.g.,^ self-esteem, locus of 
control, and life goals. Conger, Dunteman, 

* and Peng, 1976), and an investigation of the 
qu^ity of retrospective data (Lyons and 
Moore, in press). ' . • . ' ^ 

- Information on reliability is generally 
T 'ileswcable and often critical depen^ing^on how 
the cj&ta are to be used. One primary purpose 
of r^iability information is to establish sub- 
JTjective confidenc^ in t)ie manifest responses 
and statistics summarizing these re^on^es. 
Unreliability inflates variances and propor- 
tionally" broadens confidence intervals. Unreli-. 
ability also Weakens the power of statistical 
tests (i.e., ^the probability of detectinjg* true 
- among-group differences) and attenuates the 
magnitude of relationships. Thesfe ^xe prob* 
lems of "degree" and not of /'kind." How- 
ever, a number of steadies have been done ox 
^ ar^ comtemplated which use path analyses or 
structifral n>odeling. ^The consequences of 
urtknown Or incorrectly estimated measure- 
ment errors for these models can be pro- 
found: conclusions about determination and 
contributioi^ in patih analyses or structural 
modelings could well be misleading and could 
be dire/ftly opposite to the true relationships 
if errors of measurement are ignored .or are 
mcorrectly specified (cf. Duncan, 1975). 

/ This chapter reports the results of a study 
designed to provide partial answers to the 

• above issues. This chapter is oriented around 
^ the following questions: ♦ 

1. How. reliable are NLS data? 

\2. How does reliability vary as a fiinction 
of item cbaracteristics (e.glNubjec- 
tiveness, item format, item length, and 
item content)? 

3. How does reliability vary as function 
of "data Collection procedures (mail 

' versus interview)? 

4. Does reliability vary with respondent, 
characteristics? 

5. What/ interactions exist among data 
collation procedures, item character- 
istics, and respondent characteristics? 



Answ^ to these questions Will provide 
useful information pn the quality of data in' 
t|ie NLS feurvey; ,l>owever, limitations in the 
df6ig%and ^ecution of this %hidy proliibit a 
coEnprehen3ive Vr definitive / conclusioY^^ 
Consequently, generalizations to all NL^atjj^ 
and to survfys in general can be made o^r : 



a tentative firthion. The limitations are/ pnly 
a subset -of items (17) .frcta the' Second. 
Follow-Up Questiopnaiae hkvl 1^)^ included; . 
only a subset (60Q)>of NLS redpon^nts were^ 
targeted as^ participants; and tlie limited 
number of actual partieipants prohibits 
^tSailed ^compofisons of reliability.among ^b- 
groups formed by .cross-classify jRgresp6ndep> 
Chirac t^ri&Ucs and respotjdetit chafacl«ristK;s • 

by data collection modes. • " • ^ ^ 
' i ....... - V 

- . * ^ T ' " > . 

A, Sampling Prdceckj res ' ' ; - 

A probability sample of ^bO^tudents wli^' 
selkted for the Yeliabibty stiiHy. Th^ sam-, 
pli^ng, frame, fof^the rddi^ability ^tu^y agumple 
consisteti ^of 22,398 individuals 'Vrlyo >axti<fi- , 
pated. in ^ther the base.-year 'or lijrs|ilollow-Up 
surveys. This samp lihg'ftaime was^jjqft^d.by 
merging:::^e original* bas^-y^ student file ^ 
with a preHmmary- edition,x)£lthf ftfst foilpi/^ * 
,up ifile, (The finSad edited V^ergion ,jbf . the 
merged base-year ,and. first foj}lovy;up data file\ 
was ^hot available for .us^r wlxen this sfunple 
was selected )^ " . * » ' ^ ' 
, The sampling fram^ was. strktiti^d* byfsex, , ' • ' 
race, anji 'planriea activity . state -for -Ojj^oi^n 
1974 (rtem 16 of the First FoUdWrP^ fii^s- 
tionnaire). **n6t ascertained'' category waTs^ \ 
included for ^ath ^tr^ification variabfe."The 
categories' usro. for each of the stratification « 
variables were as JfoUows; ' ' , -* ' 

• 1. Sex 

2' 



m 



persons. Since strata with fewer than 5^ indi- 
- viduals wt)uld^be allocated fewer than two 
sample persojis, these cells were combined . 
with other siinfiilar cells to fQxm2^ f^al strata. 
First, persons in small cells ({,e,,1i < -561 with 
; sex not ascertained (NA) wer^ combined ♦ith 
females of the same race and activity classi- 
f ication, Thpn males with rjpice MA and active- 
it^ state NA were combined with white inales 
with activity st^ NA. The 29 finaf strala 
coristruct<?tl in this manner are Jisted in liable 

* The allocation of the total sample of ^00 
persons- to the 29 final s^atk was determined 

• in sevefal.slepsT Fir^t, a preliminary allocation 
in p^Qpoftion tp. the stratum counts was cal- 

* cula^pd as ' ' 



600 ^^ . 

22,2^9. 



where n; =* allofcaSjpto. stratum-i/ 



fi:ame sro.for stratum-i. 



Male, Female, Not Ascertam^l 

Race: White,- Nonwhite, Not Asper- 
. tained; ^ < '/ / ' 



^ Ottoberri974 Plan^: Four^ear^ 
College, Other .Postseeondary Educa- ^ 
*tionv york,*Oth€Me.g:., 'actiVe miiit^ury 
* duty, homemak^)^ Not Ascertaihecj. 

Table 6 shows the .numbers of per^ns in 
the sampling frame ' sorted by the ^cross- 
classification of the t^ree stratifiq^tion vari-""^ 
abl^. Ot the 45 cells defined jpy crossing the 
three variables, two cells were empty and 14 
additional c^lls each cdntamed liWer than 56 



' Next, -the total s^pIe*1illoiB;atiohs*f or .certain 
* , Mialysis categories ^w^re checked. Specifically, 
•^^ z^ai^i^^ oi at' least jjiop persops were 9esired 
.fj* ^eabhr^ pf th^ ,ft?Uowing' groups: males, 
^fetriiedes, persons attending" fdpr-year colleges,,- 
persons attfendiftg other p6steecondary in^fcitu- 
tiops*, ariS persons womng. Closer examina- 
' ti9n ihdicafted orilj^orje of t^iese groups—other 
^ po§tsecpi)dary educationr^ould fall short of/ 
lOO sample indi^duals. Tg insure a -sample 
fi^e of^lJMT for thisVcate'gory, the allocfttibns 
, to 'all strata mvolvihg 1974 plans 61 "other 
Tp68tsecortd*|By ec^oatibn" Vere oversmnpled 
^i.e., tpultijsilied by 1.535) and the allo^Jfons . 
to aH/strata, invblvii^ 1974 plans of four- 
yfear::c611ege" yrere OnctefsampleACi.e.,' tnulti- . 
pljed by .646)> fhese adjusted .allocations are 
shown in Table 7 in. the colutan headed 
**adjus^ allbcation/', The final alloditlorift^ 
- shown' as' the "last column in Table 7 were 
' detehnined by roupdirig *the adjusted atUo^a- 
tions td integer vahi^s ,,and by reducing the- 
i alIocatipn3 to the largest strata to force a total 
. sample siz^ of 600 persons. ^ - ^ ' . 

•The* last step in drjiwing the reliability 
/^tudy/ sample involved, the selection. of the^ 

number s>f p^rspns in th^ final allocation 
' column for eal^ stnltum from the total 
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number ,in the stratum sampling frame. These 
selectrobs were maj^e with equaLprobabilities 
and without replacement using random 
numbers genera'ted by a computer program. 

B. rn^ruments^ 



Th/ questions used for the reliability 
analyses are a subset of .items from the 
Second Follow-Up^questionnaire. This subset 
was extracted^from .the Second ^triS|-Up.' 
questionnaire and compiled into ^|nurate ' 
"short form" questionnaire '^(the fiii SK i of 
data for the "test-retest'^ design vi^^e 
responses to the selected questions embedded 
in the Second Follow^Up questioni\aire; the 
^ond set of data were the fe^onses to tlie 
short form questionnaire). f , 



The decision as to how trtany and- which 
items to include .in the r^ltebility study was^ 
made j)rimarily on the basis of* thfe following 
criteria: '(,1) respondent burden,^.e., the^tjues^ 
tionn|iire should be brie;f arid require xio more 
than 15 minutes to complete; (2J amenabilitjr 
to analysis, i.e., the stability or consistency of 
the items should be capable of estim'ktion by 
questioning tHe same respondent^ at two clqae 
points in time; (3) criticality, i.e., the items ' 
should b^ important or central, to the basic 
NLS analysis; and (4) representativeness, 'i.e., 
.the items shptild represent the variety of' 
.formats, content areas,' and reliance on fact 
versu^.miljiective opinion. ^ ^ 

!^^d^n these criteria, 17 itenSs (Table 8) 
were selected for inclusion in /the reliabihty 
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" TtWi7 . 

DESCRIPTION OF STRATA USED FOR RELIABILITY SAMPLE 



\ ~ ' Final 

I Franw Prdiminiry AdfilstMl Sampto 

Stmniii* Sw ' Riet 19|74 Plans S«t Alloortion ^ Allocation AMocation 



1 ^^^L Male Whto ^ Colegft > 3.6H .97.4 82.4 81 

2 * NA r M*9« 360 _ 9.7 8.2 8 

3 . <«Wa • Whita Other Education 916 24.7 375 >.37 

4 Mala NA* Othjif Education 93 2.^ 3.8 4 
Mala White Worik 2^60 6S.1 89.1 . 68 

6 Male NA Work 242 6i i ^-^ ' ^ 

7 / Male White Oth^r 432 11.7 11.7 12 

8 Mala . NA Othir 58 ^ . 1.€ 1.6 • 2 

9 Male White NA. 431 11.6 11.? 12 
• Male NA . NA ' 

10 Male ' Nonwhite Coli^ 85r 232 19.6 > 20 

11 Male Nonwhite Qth^r Education 3S1 9.5 14.6 15 

12 ' Male Now^ite Woric 701 185 '.-185 19 
n Male Nonwhite Other 169 4.6 ' 4.6 5 

14 Male Nonwhite NA 175 4.7 4.7 * 5^ 

15 " Female White Collaje. 3,055 " 824 69.7 69 

NA White ^ Collet ' ' . ^ ' m 

1(5 Female NA College 305 ^82 65 ' 7 

NA * NA . College 

t7 finale White ) Other Education 762 , 20.6 . 31.6 32 

NA . White J Other Education' 

IB . Female NA Other Education 65 , ' 18 2.8 3 

19 Female \ White • Work 3,023 81.t[ 81.6 * 81 
NA ' White Work , . ' 

20 Fema|4 NA Work 295 . 8.0 8.0 8 
NA . NA Work 

21 Female White Other 775 205 205 : 21 
NA White ' Other 

22 Female NA Other ' 76 , » 2.1 21., 2 
NA.. ' MA' Other 

23 Fe^nele ^ .White NA / '252 6.8 * 6.8 7 
N NA White NA 

24 Female • NA NA ' 132 35 3.6 4 
NA NA NA ^ ■ 

' 25 Female Nonwhite College % 974 26.3 22.2 . 22 

NA Nonwhite College 



26 female . Nonwhite , Other Edlcation^ 460 12.4 ^ 19.Q 19 
NA Nonwhite ' Oth« Education^ ' - ' 

27 ^ FervMle Nonwhite Work ^ 831 * 22.6 \ 22.6 23 

NA. 'NQnjivhita Work * . 'I 

28 ( F^emale Nonwhite - Other 144 35 ' 35 4 

29 Female Nonwhite NA 124 ' • 35 35 ,3 
N/^' ' Nonwhite NA 



Total ' 22^139 600J ♦ 6002 ^ 600 

Subtotal , ^ College (9,164) (2472) (209,0) (207) 

Subtotal Other Education (2,647) (71.4) (109J) f^lO) 
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DESCRIPTION OF ITEMS EXTRACTED FOR 
REIIABILHY STUDY 
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study. The^ 17 items are identical in wording 
and format to those of the Second Follow-Up' 
questionnaire. (A copy of the Short Form 
Second^ FoUow-Up questionnaire is provided 
^ in Appendix A.) ^ 

: , 

Data Collection 
Procedures 

The data/were collected for this study, 
and for N|ps as it Whole, through a combina- 
tion of mail, field interview, and telephone 
efforts. Data collection activity for the reli- 
ability study actually began the second week 
of October 1974 with the initial mailing of 
. Second Follow- Up questionnaires to all NLS 
sample members... All incoming Second 
Follow-up questionnaires completed by mail 
or by personal interview were event-coded 



\ 



into ja <:omputenzed Real Tibie Control Sys- 
'tem. A^computer printout ^identifying reli- 
ability study sample members whose • long- 
form .questionnaires had been received was 
generated on a daily basis. 

Short-form guestionnaires, witli a cover 
letter <see Appendix A), were therf mailed to 
reliability study ipembers who returned their 
longrlprm questionnaires bj^ mail. This event . 
occurred no earlier than ten days after the 
completion date jtienoted on the background 
information^ page of the Second FoUoW-Up 
questionnaire. TWo weeks after the mailing of ' 
the shortform' ijuestionnaire, a jprompting 
telephone call was made to the norne^ond- 
ent ^^OMraging him/her to return the ques- 
ti^pflaire. If the ijonrespondent indicated that 
e/she"had either lost or had nev^r received a 
short-f6rm quesfionnairie, car if the nonre- 
spoffdent could riot be contacted for prompt- 
ing, then a s^ecopd mailout occunred imme- 
\diately. No further attempts were, made to 
Obtain a response, %- 

* ^ Reliability simple members who com- 
pleted a long-foi^ questionnaire by personal 
iijjterview were recontacted two weeks after 
the first interview, at which time an interview' 
with th^ short-fbrm questionnaire was com- 
pleted. 

Each returned short*form que3tionniAe 
underwent an initial editing process to deter- 
mine whether or not it contained adequate 
information for acceptance and entry onto 
thfe data* file. Generally,* the editing pro«;e8S 
pequired crosp-cTiecking a respondent's 
answers to each of 12 "key" questions on the 
short f ojrm with his or her answers to the 
same questions on the long foi[m. The 
decision Tul6 for determining whether or not a 
*key question '(arid, therefore, the short-fortn 
questionnaire) should fail edit may be stated r 
^ fof^l^ The fail-edit condition results if 
r^nd otf^f a key question was appropriately 
answered on the long-fonn questionnaire but 
was unanswered or inappropriately answered 
on -'the . forr^i^ppnding short-form question; 
r>aire. ^. . . A 

If a respondent's short-form questionnaire' 
failed edit,* a tel^phon^ call wa& iliitiate^ aiui 
an aj^mpt ^s made to obtain* information 
for the Vey iten|s that the re^ondent failed 
to answer. Edited short-form questionnaires 
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the relevanti portions of the ^orre^ond- 
ing Secoifd FoUow-Up (Icyig-forrnt) question- 
naire were then coded* anid keypunched. Alr^ 
dat^collection activities /were completed by 
30 April 1975. , 

/ 

D« Data Analysis Proc^ures 

The variety xd fetearch questions, data 
coUectioiT procedures, itent^^and item uses 



4e.g4 oi}inposite&) r^uires a variety of ana- 
lytic prod^res. Tirst.of all, the items. have 
been classified (Table 9) as either categorical * 
or isontinuous in nature. Reliability estimates 
for cafe^rical items are biased on the percent 
agreement in responses (including item non- 
resp.ons^) across the two time points, and_the 
(Jggree of^-asiociatibn is additiopally suinma- 
rized by.CraWi^ V (cf. Statistical Package 



: TabltS ¥ 

VARIABLE SPECIFICATION AND DESCRIPTION 



SlMft Fmhi Ham Nttmbflr 
Cnifoncd VaHabl« 



Dtscriptioii 



1 

3 
5 
6 

17 

Continuous Variabrts 

2 
4 
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10a 

10b 
10c 

11 

12 SQ12, LQ 
12 SQ12, LQ 
12 SQ12, LQ 
13 



15 
15 




15 
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16 
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Ethnic lalf-dtsaiptiont (8) plus missing clustarad 
into 3 catagortts: whita, nonwhita, and missing 
School typai^ plus missing 
Work acttvitpMagories (3) plus missing 
Cansus coda job dascription-an^zad major 
classitotions 

Employar typM W plus misKg 
Marital ttatusas (4) plus misting l 
Educitionar(7) axpactancias (7) plus mi^ng 
Cyfer goals (17) plus missing 



School attandanca (dichptomous variablei ^ 
School parformanoa (st«an [avals of saH-ntportad 

grada) i 
Data of tmploymant: for job t^ald in October 1974: 

scorad as nufnbar of months from Dac^ber 1971 
HouTMMirtad par waak (write in response) \ 
Number of dependents: 0J,2,3,4 \ 
Own income (write in) 

Spouse income (write ih) ^ - 

Other income (write in) . / 

'Total income (write irD 
Self-esteem composite* (items e, c, d, end h) 
Locus of control composite* (items b« and 
Consumer composite* 1 (items e,b, and d) 
Consumer composite* 2 (items e ajjd f) 
Consumer composite 3 (item c) ^ 
nansi6)-each of e-fimdfed asedic;liotomQus 
variable (epplies or does not aptily) with 
responses esujmed missing only if eH ere bjenk 
Work compostte* 1 (Items e end b) 
Work composMt* 2 (items c^e, t end i) 
Work composite* 3 (items g>/and j) 
Work composite* 4 (item d) 

S'ork orientation* (himfa, c, end e) 
ommunity orientetion* (items f, g, and j) 
Family orientation* (items b, h, end i) ^ \ 



' Compom^lcortt computed by Mraging available raipjmiai C 
NLSttudiet. ^ « ' 



Compotitat uatd are baaed on factor arwIyMt from praviout 
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^ Social Sciences, 1975). Rekability esti- 
^8 for the cpntinuous and dichotomous 
^lUDftbles are provided by product-momeri|;-^ 
cbi^relations on ^fe available (test-retestjj 
responses. ^ / 

/ In order to address the various research 
qiiestibns regarding data collection procedures , 
a^d re^ondent characteristics, the following 
pirocedures were employed; 

/ 1. Categorical variables: reliability esti- 
^ mates for subgroups were calculated 
as percentage agreement and Cramer's 
'V; differences ii;x reliability among 
subgroups were determined by com- 
paring percent disagreement' and 
agileement among subgroups using a 
' procedure. That is, for each 
respondent an each categorical van-, 
able, responses across the two time 
^points were compared and scored as 
either ^^disagreement*' orj "agree- 
, ment." These scores w^re thea cast 
,into a kibgroup by agreement cross- 
tabulatipn table and analyzed by a x^. 
statistic! For each variable designed as 
> categorical ^Hhe foUowmg analyses 
were done: > 

a. jiData I Collection Mode by Agree- 

b. Sex DV Agreement, 

c. Ethnicity by Agreement, 

d. . SES by Agr^ement^J ' 

e. Abilit^ by Agreement, 

' t Sex Within a Dati^ Collection 
M0e by Agreement, i 

' Ethnicity Within a Dai a Collection 
Mode by Agreement,. 

h. SES Within _.aJData Collection- 
Mode by Agreement, | 

i. Ability Within a Da4 Collection 
Mode by, Agreement. / 

2. Continuous variables; reliability esti- 
mates for subgroups were computed 
by' product-moment correlations; 

I' differences in reliability among sab- 
groups were determined by comparing 

' these correlations using tests on 
Fisher log .transformations of .the 
correlations. The correlations were 
calculated on available test-retest data 



with no imputation for missing obser^ 
/ vations. 

I As part of the \full-scale Second Follow- 
Ifp survey, Ipng^form questionnaires data*^ 
\^ere obtained ^Sm &58 of tjie 600 desig- 
nated participants. This return rate of 93 per- 
cent is very similar to that obtained for the 
/entire sample, The second, questionnaire 
(short rform) was administered to- these 558 
initial respondents, but only 462 shoirt-fonrt 
questionnaires (82.8 perc^t) were com* 
plete^. The larger than normal attrition from 
long form to short* form obviously introduces 
sbme potential bias. In order to further teyes- ' 
tigate this^roblem, an analysis was don^ to 
see- if a' differential req>onse rate was asso- 
cia^ted with demographic characteristics of 
se|x, ethnicity, SES, and ability. These analy- 
ses indicated tt\atL^.na major or statistically 
significant differences in attntion could be 
associated with these demographic character- 
istics. 

' --A seccn^ preliminary analysis was done 
on methoc/ of data collection. Of the 462 
respondents providing data on both the longh- 
and short ibrm, 133 (28.8 pi^ent) were 
interviewed and 329 (71.2 peit£^ provided 
dafa by mail or mail phis telephoQe^ solicita- 
tion for crilical data. These analyst compar- . 
ing mode of Response among classification 
subgroups de fined by sex, ethnicity, SES, and 
ability showed that nonwhites were more }ike- 
ly to tie intei viewed than whites (44 versus 22 
percent), lo\r SES persons were ittore likely 
(36.1 percen:) to be interviewed than either 
middle (24.3 percent) or high (22!0 percent) 
SES persons and I6w ability person^^ were 
more likely io beLftferviewed (39.2 percent) 
than middle. lability ^yemns (24.3 percent) • 
an'cj this group in tUm was more likelj^to be 
interviewed than high ability persons .(11.4 
percent). Theap differences in data colle<?tion„_ 
procedures "Hs U function o^f ethnicity, SES, 
and ability counLmtroduce bias into subgrqup 
reliability estimates to th^^extentj that reli- 
ability is differentially associated with data 
collection procedures. Foi iBxampl<}, if inter- 
view data are generally more /rel able than 
mail-in data, nonwhites, low SES, cr low abil- 
ity persons could shoW higner j reliability 
values than their cpunterpMrjs. ^hile this 
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[ot necessarily introduce bias into the- 
[1 reliability indices for fi}e entire NLS 
iple, it definitely would liitiit generaliza- 
tioixs tO'Survey research as a whol6. As a result 
of" the diffelrences in data collection proce- 
ct^res among subgroups, it was decided that 
tfibde of response needed to be controlled for 
in subgroup analyses. This has the unfortu- 
nate consequerfce pf severely limiting sample 
for cross-classificHtions (e.g.„^. sex by 
e^nlcihr) among th^ major classif^^i^ion vari- 
ables and even among subgroups wifiiin a 
classification variable within a data collection 
mode fiCe.r^only eight high-ability persons 
were interviewed). ' * 

Tables 10 and. 11 present the total sampl^ 



reliability indices for the categorical and con- 
tinuous variables, respectively. The reliability. 
Qf>^he items included in this study is generaihr 
quiteN;easonable. Based oh the correlation 
coefficients and Cramer's V coefficient for 
categorical data, the median reliability is .67. 
The reliability of some item^, however, is 
quite low (e^., .36 for other^ipcome, .41 for 
nonacademic educational plan^, and .48 for 
"pther'' plans). The highest ^reliability ob- 
served fof the total sample wa5'.92 for school 
attendance. 

T^ible 10 also presents percents agreement , 
fo^ the total sample across the two time 
points for the- eight categorical variables. 
These percents present a mpire favorable 



TaWtJO , * 

OVERALL RELIABILITY AND RELIABILITY AS A JUNCTION 01^ DATA COLL|CTION PROCEI^URES: 

(CATEGORICAL VARIABLES) 



\ 


Total Sampk 




9 ' t ' ' 

i OHm CoNwtion Groups 


Ptfctnt 
Aimmtiit ^ 


Ctamar's 

V 


Pimnt AirMimnt 
Mail InttrvMW 


Ethnic itlf-dtschptlon 


97.2 


.67 


96.4 


997 


Type of school 

WbrkictMtY 7 


944 


^3 


93.3 ' ' 




90.7 


.75 


89.4 




Job dtscfiption 


: 88.5 


^3 


^ 863 


92.5 


Typt of imploytr 


8J7 


J6 ' 


88.4 . 


85.7 ( 


Marital ftitiis 


90.0 


.72 


903 


\ ■ 88.0 \ 


Etfill^loMl sxpidations 


. ^ 70.6 


.59 


72J) 


664 


Cariir goais at 30 * 


67.7 


'.64- . 


62J* 


79.7 


A ' " ' ■ 


462 


462 


329 


, "T33 


* Difference between ^bgroup percent agreements it significant at p < .00 

■ \ ■ ■ . 
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TabI* 11 



itVERALL B£LiA^fl$IY AND REUABILITY Iftf A FUNCTION OF DATAJCOLLECTION 
PROCEOVRES: CONTINUOVS VARIABLES " 



Pit! ColtoctioB Group 



' Total Sampit (r) , 



RiiKr) 



Intarvitw (r) 



^ School attmdanea 

School ptrformancf 

DM o) •mploymant ' 

HoiinworfctdAmk 

Numbar jif dapandents 
^&wn-inconM 

SpsusaJncoma 

Othar incoml^ 

Total incoma 

Salf-aitMm 

Locus of control 
^ Consumar bahavior 1 

^Consimer bahavior 2 . > 

Contunwr bahavior 3 . ' 
- Plans: Working' 

Plans: Acadamic education 

Plans: Otha^schooling 

Plans: Military ' 

Plans: Homemakir 
' Plans: Othar ' / 
. Worki 

Work 2 

Work 3 

Work 4 . . ■ 

Work goals 
CommunKy goalt^ 
Family goals^ . 



^2f(453) 
.81 (211) 
.66(288) / 
.81 (293) / 
||(448)/ 
.11(369/ 
.67 (228) 
.36 (221) 
.74 (363) 
.66 (454) 
.71 ^454) 
.63 (455) 
.5*8 (454) 
.50 (447) 
..n (459) 
.85 (459) 
.41 (4S9) 
.86 (459) 
.84 (459) 
.48 (453) 
.56 (449) 
.66 (447) 
.54 (447) 
..5fi (441) 
.68.(45T[) 
.67 (457) 
'.68 (457) 



^2 (320) 
.78* (161) 
.64. (198) 
.78°tf02) 
.78= (318) 
.57" (252) 
^4= (132) 
.34 (124) 
.705-«47) 
.67 (324) 
.68v (324) 
.58*^(325) 
51"= (324) 
.50 '(319) 
.79 (326) 
-.84-4326) 
.31"= (326) 
.81"= (326) 
.82* (326) 
.43' (32« 
.55 (319) 
.65. (317) 
.47" (317) 
.51* (311) 
.65 (327) 
.65 (327) 
.68 (327) 



"53(133) 
.89 (50 ) 
.7S1B5 ) 

."75(117) 
.35- (96 ) 
^0(97 ) 
•55(116) 
. .60(130) 
.73 (130) 
.75 (130), 
.72(130) 
.52 (128) 
.71 (133)- 
57 (133) 
■ .60 L133). 
1.00(133) 
-.89(133) 
.66(133)^ 
.58(130) 
.69 (130) 
.69 (130) 
.65(130) 
.74(130) 
.73(130) 
.68(130) 



Numb^s in j>arentheses are sample sUes. Numbers differ across variables due to respondent nonresponse. 



Letters a, b, refer to significance levels 
indicates p < .01, and c indicates p < .001 
transfornnations of the correlations. 



for between-group comparisons of product-moment correlations a indicates p < .05, b 
The significance of difference;! between correlations is based on a test on Fisher log 



picture than do the coefficients of associa- 
tion.* Four of the categorical variables, had 

* This discrepancy results from the inheJent 
characteristics of these two statistics, 
percent a^ement index is a measure of 
Jigreement for the average respondent ignor-t 
ing categories of response while Cramer's V 
is related to the ^^eement, of the average 
response category. Dlffergnces between the 
two statistics 'indicate that some response' 
categories are likely to be highly unreliable^ 
For ^example, ethnic self-description had a 
92.^7 percent agreement index but a .67 co- 
efficient of ^association. A closer examina- 
tion of that crosstab talkie revealed that thA 
major frequency categories of white and 
nonwhite had high percent agreements but 
the category *^ot Ascertained" had 0 per- 



percents in the 90's: 97.2 percent for ethnic 
self-descripMon; 94.4 percent for type of 

cent agreement. Ea^ch approach is legitimate 
depending on the use; however, percent 

^ agreement indices tend toTresult in higher 
values. In fact, a high^ percent agreement ^ 
could result from totallj^unreliaye data^as 
measured by coefficients of association. For 
example, a hi^ endorsement rate for a 
single response category on both testing 
occasions imposes a hi^ percent agi^ment 
qverall. If, for example, 99 percent.Of ^the 
respondents claim to have a dictionazy^ 
— the home, the test-retest percent agreement 

' must be at least 98 perpent. But if the over- 
ail agreement were 98 percent, a ^ coeffi- 
cient calculated on Oie same cjaia would be' 
-.01. 
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school attendee^; 90^.7 percent tpt^ffptk statuB 
and 90.tJ ^^tpmt for marij^l stktuf. j^duca* 
tional exp^tadms and caiiwr go^ls ^fetbe age 
;»30 had m^^ower^ehts i<m6 and 
87/7 percent, re^ectiv^lyj). > 

1; Resulti: Cor^t /^;^ 

-and Fornnrt - - * 

Some yanation nn the 't^liabilitiesr can be 
associated with a dimension of objectivity- 
subjectivity. Amdng th^li^tegoncal varial^les 
both indices .of -;reliabiiits;^ (CramgrX V and 
percent agreement) show^cthat. the. twp njo^t 
subjective items/ (educati|^nal expectations 
and career goals)^ad the lowest'rejiabilities 
(Table 1,0); however, the percent agreement 
indices . piovide^' the sharpest delineatior^ 
between the subjective and objective it^ms/^ 
Amj^ng the ^7 variables handled as con tin- ' 
u^tifr^ior dichotomous measures there was a 
la|g0]^^gree of variation in the reliabilities. ^ 
Tfe^r!jnediaD reliability of the five factually 
Wiejfefl ^t^s (Table 11) was higher than the 
medijK^relilbility of the remaining subjective 
items^.81 versus .67) with only one factual 
item (hours worked per week) not Ijeing 
superior ^o the subjective items. Based on 
these fesuL|;is one can assert that subjective 
variables ^re per se generally less reliable than 
variables with a factual bias. One jmust^ also 
consider that a jroffTber of the subjective vari- 
ables ^are convposites 'sjhd thus have a higher . 
reliability than Itie single items malcing up the 
•components of the 'corAposites. Thus, it cojr/ 
rectipnsVwere made for this factor, the 
factually oriented items would emerge as even 
more reliable than the subjective items. 

Systematic variatiohs with other item 
characteristics are not apil^arent. Seven of the' 
items are open-ended (job description, date of 
en^loyjnentv hours worked per week, and the 
fouj ^ncope item^). These items cluster 
around the median vel^bility of .67. One item . 
(expected activitjj in Octobp 1975) *was -a 
multiple responsfi^ itenv reqiflnng respondents 
'appropriate responses.^This 
rail median reliajbility of 

two of the three lowest* " 
ssociated with components' 
or noncoUege educational 
plans and .48 fOr miscellaneous plans). It^ms 
embedded in skip patteflis (short form items 




multiple respon 
^o circ^all of 
item h^d an 
about. .80; 
correlations 
of this item (. 




3, 4, 6^t?md 7) wWfckrivere all factual in na|?^ 
were neither' be ttic nor worse than factual 
ttentsnotsoeojbpraed. ^ 

Thl^ Jji ^he items (ethnic self- 
desc^iptioiin^d of school attended, plans tor 
October 1975) irtphided a waste basket re- 
sponse categcwry JSthed "other./ The,percent , 
agreement across the two time^points was 
quite low in each case. Ifhe variable "other 
income" also* manifested " a low test-retest 
c o r r e latiop . Taken in conjunction , these 
results would tend to indicate that the u^ of ^ 
catclVall or rhisceUaneous response categories 
does not provide reliable data. 

^ 2. Results: Data Collection 
Procedures 

• 

Viuriation in reliability was also associated 
with the mode df data c6Ue<!ti<u|4mail-in or 
interview. Fifteen of ttie* thir^^^w variables, 
investigated showed significant amTof ten sub- 
stantial differences in reliability ^i^^^a j^nbtion 
of djata collection, mode (TablesTlO aijd 11). 
Ohe difference (S^ousf's income) strongly, 
favored the mail-in procedure, but this dv£f»' ' 
ence should not b¥ interpret<ed without refer- 
ence to the sex by mode interaction discussed 
below, .'the ^remaining fourteen differences 
favored the interview procedure. These differ-'* 
ences cut across the item characteristic differ- 
ences prevkmaly described, biut most of them 
were, also jnvolved in interaction with other 
respondent characteristics. Despite th«se 
interactions, however, it seems fairly safe to 

'conclude that interview -obtained data is more 
reliable than mail-in data. The previously 
described 'relationship between respondent 
chaifacteristics and probability of being inter- 
viewed would indicate. that substantial differ- 
enced -in data quality probably exiirt^ across • 
individuals bbth as a fun(;tion of mode of data 

- collection (a direct effect) and as a function 
of respondent characteristics (an indirect ' 
effect). • y 

3. ReiUitt: * Variations Associated 
with Respondent Characteristics 

^^^'•"^eliability variations as a ^nction of re- 
spoiklent characteristics will be - discussed . 
ri^tely foj the categorical variables and|ffij^* 



the^pntinuous variables. 



Among the categoricat variable§ there 
'fnete no differences asso^ciate'd with ethnicity* 
^; or SES and small differences associated with 
and ability or their interactions with data 
flection procedures. 

Table 12 shows the,j)erc^>tN agreement 
indices for males and jfemSI^ overall and 
within data collectiorr^.modes. Overall, the 
Comparisons indicate that females are more 
reliable then males when theUe is a differenci^;. 
however, these diffarertces emerge'^mjuril^y' 
iti the mail-in data collectiorf^ocec6re" ^our 
of the five chffarences show that females ^ 
more ^reliable than males for the mail mode 
w^th no differences for"A^ interview mode. 

Among the three ability groups there was 
only one overall difference (marital status, 
T^Me 13), but this is qualified by an'ability 

mode interaiction. There were thF§e signifi- 
cant differences among the ability ^oups for 
the miSl-in questionnaires and nonsignificant 
differences among groups for interview- 
collected data. All of the significant differ- 
ences wferei of llie same type:* Ibw ability per- 
sons were less reliable than either middle or 
high al^ility persons. The latter Iwo groups 
were generally comparable. . , 

. Fof contimitui^ variables, a quick glimpse 
at Tables 14 throy^ 17 indicates that a large 
number ct .diffei^ruifs exist among groups 
differenti^itedx on thj? bfisis of^sex, ethnicity, 
abili^' and ?nd thlir interaction with 

data.^ltefction procedures. Only 4*of the 27. 



items classified as continuous variables 
.sbowed no difference among any groups (con- 
sumer cdi][iposite plans for education other 
than college, and community anb family life 
goal^ the first two of these, however, ha^v 
differences in reliability as a function ofdala 
'collection procedures. - . 

Altogether, 16 of the 27 variables (Table 

J^4) handled as continuous or dichotomous 
dpta produced sex by data collection i^ode 

^^teractiohs ancf an additional 2 items only 
Had an overall sex difference. Twelve items, 
h6wever, manifested a difference in reliability 
between males and females when the data 
collation procedure is ignored, '^he items for 
which thejre Was no apparent* interaction 
are: own income (males substantially more 
reliable than females), self-esteem, and locus 
of control (females m^e reliable than mSlesK 
For the remaining items involving inter-^ 
actions, differences occurred between males 
and females within both data collection 
t)rocedures. Within the mail mode fqur of the 
differentia in reliability favored i^ales and 
four favored females. Males mote reliably 
reported total expected income^ plans for 

'college, and militairy and homeniaking activ* 
ities for the following yWr. Pemales more reli- 
ably reported whether or not they were 
atteiidin^4DhcH>l, school performance the past 
year, date of employment- for their current 
job, and plans for nonacademic schooling in 

_t)4e subsequent year. ' ' 



Tablt12 

^ST R€TEST PERCENT AGREEMENT FOR SEX GROUPS: CATEGORICAL VARIABLES 



DtKHptMMI 



MiS Mod 9 

Sijt Groups 



IpittwiiM Rifdt 

-Sex Groups 



AH RnpondMits 

Stx Group^ 



FmimIcs 



Type gf school 
WorkKtMty' 
Job dMcription 
Typt ofyimploy^ 
Educatibnal •xp«tations 



■t 88.9° 
■ 84.3^ 
81.0*^ 

65.4* 

"153 



97.2- 
93.8 
92.0 

77.8 

176" 



97.1 
94.1 
92.6 

70.6 

68 



' 96.9 
93J 
92J 

63.1 

' ' 65 




84.6* 
84.2* 

67.0 

221 



97^^1 
93.S 

735 



241 



L«tt|n a, b, c, refer to figrfincar>c8 levcif for betwMff-gr^up compsritoni of ptrat»tff 
M,b indicatet p < .01 , and c indicatst o < .001. 



uting a x ttatntic a' indicates p < 



TEST RETEST PEtlCENT AGREEMENT FOR ABILITY GROUPS: CATEGORICAL VARIABLES 



DticHptiQii 




RMafll 'AAotf a 

Ati/ity Groups 






Lil^rviiwrlloda 

Ability Groups 






All Raspoitdtnts 

Ability Groups 




Low 


lliddia ^ 


Hi|h 


f Low 


Middta ' 


Hi|h 


Low 


Middia 


Hi|h 


Job dwriptiorr 




93.0 


83J 


94.7 


87.8 


100.0. 


84.5 


91.7 


^5.7 


7yp« of tmployer 


8 1.4' 


92.2 


93.5 


89.5 


80.5 


75.0 


844 


89.3 


9t.4 


Marital Status 


nj^ 


92.2 


95.2 


94.7 


95.1 


100.0 


85.6* 


92.9 


95.7 


N 


59 


128 


62 




.V 


8 


97 


. 169 


70 



X 



Lctteri 8, b, c, refer to significance levels ior between-group comparnont of percent agreement using a statistic: a indicates p <: 
-05, b indicates p < .01 , and c indicates p < .001 . - \ 



Within tlie interview mode, *^iye -differ- 
ences j favored males and three favored 
females^. Males more reliably reported date of 
employment ffeversing the relationship, 
observed in the mail mode), number of 
dependents, spoUse's income, miscellaneous 
plans, and were more reliable for consumer 
composite 2. Fepiales were more reliable on 
- hours worked per week, other income, and 
wOTk composite 4. 

— *o 

These results cannot be easilysjnterpreted, 
but 5ome rtay be dismissed. In particular, 
little meaning should be associated with 
diffStences between males and females oh 
* plans »foY the militalry or pl^ns for home- 
making activities. In| the former case, atou^ 
one pcrcenf the females indicated a likely 
military involvement and in the latter around 
one percent of the males indicated a likely 
role as a homemaker. 

The deference in reliability between 
males and females on spouse's income in the 
interview procedures is, however, interprett- 
able. Females were geiieraUy less reliable than 
males in Reporting their own expected income 
and total expected inconle, perhaps indicating 
that they are not as attuned to financial * 
matters as males. Consequently the highly 
"'Unreliable report of spouse's income in the 
interview mode (r " .2J^) relative to the mail 
mode (r = .91) could irftlicate that^ th^ntail 
^ode, the females requested this ir^formation 
from their sp)Ouses (who were nof available in • 

. .■ ■ I ■■ 



the interview mode). One must also consider, 
hpwever, that females in the interview mode 
very reliably reported other income—the only* 
group across modes to do so. 

In general, while arJarge ngnber of reli- 
ability differences between male! and females 
do exist, they <io nor lend theipselVes to ^ 
comprehensive interpretation, nor^do they 
consi^ntly favor ^e group over another. 

Numerous differences (Table 15) in reli- 
ability occurred betfveen whites and non- 
whites. Nine differences (school attendance, 
.number of dependents, own income, spouse's 
income, locus of control, military and home- 
making plans, and workromposites 1 and 3) 
ware interactive in nature (i.e., occurred only_ 
under one data collection procedure) and four 
differences occurred independent of data 
collection mode (date of emptoymentp, other 
iipcome, total income, and self-esteem) 4 Of the 
20 significant differences in Table 15, 14 
favored •nonwhites over whites, a finding not 
indicated by prior research on the reliability 
or validity of survey data (see review chapter). 
Jive^f the.^ix differences for which whites 
were mjf>re reliable than nonwhites occurred 
on subjectively oriented data (selfresteem, 
locus of control, and work composites 1 and 
3)., By comparison, only 3 of the 14 differ- 
ences favoring nonwhites were^ subjex^tive in 
nature (knilitary and homemaking plans). 

Of particular interest are the six white- 
non white differences in reliability, for incoine. 



, ttUft14 V ' 

RELIABILITY tOR SEX GROUPS: CONTtfHJOUS VARIABLES 



Mia Mode 

5^jr iroups 



Inttrview Modt 

Sex Groups 



it) 



(r) 



(r) 



Ftmilti 

- Ir) 



(r) 



All Ropondtnts ' 

Sex Groups 



School atttndanc0 
Schooj porformanct 
Oatt of tmploymont 
Houn\MOi^/wMk ^ 
No.iifiltp«nd0nt$ 
Own income 

\ 

Spoun income 
Other income 
Tot^pcome^ 
StH-fstetln 

Locus of controL^'^ ^ ^ 
Coim)her bthsvior 2 
Plans: Working 
Plans: AcadiMtiic education 
Plans: Military < 
Plans: Homsmaking 

4 

:f1am: Othar 
Work composite 4 



39' 

(149) ^ 

(79) 

» .51= ° 
- ; (99) \ 

.79 ; 
^(100) 

.78 

' (14« 

*.79= ' 
(119.) 

J1 
*"(49) 

.49 

(52) 

.89= ^ 
(T14) 

.60^ 
(1M) 




35 
(171) 



J3 
(68) 



^1 



.90° 
(217) 



Number* in perenthetes indicate sample tizet 



Letten a^. c, refer to significance leveli for between-group companions of correletions: a indicates 
and c ir>dicatet p < .001. The significance of differences,l^tween correlations w bated on a x' test on 
the correiations. 



.94 

(236) 



.86 




•oO 


7R" 


AID 




(7&) 


(221 


(107) 

^ WW/ 


(104) 


Ml 




Ml 


.61" 


.75 




(RO) 


(40) 


(149) 


(139) 


.76 






.81 


.o 1 










(142) 


.76 , • 


■ir 


.85 ' 


J5 


7ft 






(64) 


(2f4) 


(234) 


.42 




.56 


.09 , 


.40 


\ 100/ 


(62) 




(181) 


(188) 


Jo 








.0^ 


\oo/ 


(51) " 


(45) 


(100) 


(128) 






Q1 


.09 


SI 


(72) 


(53) ^ 


M44) 


(105) 


(116) 


.04 


A OA • 






67 


(133) 


(92) 


(54) 


H176) 


(187) 


71 
.10 




* ./u 


.90 


.72 


(173) 


(66) 


^64) 


(217) 


(237) . 








.Do 


.75 






• 


(217) 


(237) 


.54 


.83 


.60 


.62 


.56 


(173) 


(66) 


• (64) 


(217) 


1237) 


.85 


.70 


,1\ 


.72'' 


n 


(175) 


(68) 


(65) 


(219) 


(240) 


•80. 


.87 


.88 


, .88'' ' 




(175) 


(68) 


(65) ^ 


(219) 


(240) 


.57 


'1.00 


1.00 


.88= 


.70 


(175) 


(68) 


V (65) 


' (219) 


(240) 


.78 


X 


J8 


.82 


.81 


(175) 


(68) 


- (65) 


(J19) 


(240) 


.48 


Jl" 


.57 


•48 . 


.49 


^(175) 


(68) 


(65) 


-(219) . 


(240) 


.48 


.55' 


.76 


.55 L 


.56 


(164J . 


(66) 


(64) 


(213) r 


(228) 



p < -05. b indicates p < .01. 
F If her log tranfformationi of 



•24^. - 30 




TidU IS 

RELIABILITY FOR ETHNIC GROUPS: CONTINUOUS VARIABLES^ 





Mi Modt 


Intirvitw ftlodt 


M Rvpondtnti 


Ethnic Groups 


^ 'Ethnic Groups 


Ethnic Groups 


/♦ 


Wbitt Npnwliiti 

(r) (r) 


White Nonwliiti 

" Ir) it) 


Whitt Monwhiti 

Ir) ^ Ir) 



School itttndance 
Data of employments 
No. of independents 
Own income 
Spouse income ' 

9 

^her hKoim 
Total income 
Self-estwm 
Locus of control 
Plans: Military 
Rant: Homtmaking 
Work composits 1 
Work compos'rte 3* 



,(266) 

.61" 
(164) 

(267) 

.60 
(219) 

.94 
(116) 

[33. 
(108) 



.67 
(268) 

.76« 

(?70) 

(270) 

.60'' 
(265) 

.47 
(262) 



.92 
(54) 

.84 
(34) 

.90 
(51) 

.41 
(33) 

.90 
(16) 

.6» 
(16) 



(56) 

.92 
(56) 

.77 
(56) 

.24 
(54) 

.46 
(55) 



55" 
(84) 

.7fl' 
(6^- 

.95 
(82) 

.88'= 
(76) 

.28"= 
(60) 

'.29"=. 
(59) 



1^1° 
(82) 

1.00 
(84) 

.Be" 

(84) 

.64 
(82) 

.73« 

(82) 



.86 
(49) 

.98 
(28) 

.93 
(481 

.93 
(41) 

.995 
(36) 

.86 
(38) 



.54 
(48) 

1J)0 
(49) 

■ (49) 

.46 
^ (48) 



, .93 
(350) 

.61' 
(226) 

.80* 
(349) 

* .62' 
(29$) 

.65^ 
(176) 

.30"= ■ 

• {167) 

.72^ 
(288) 

-.70" 
(350) 

.71 • 
(350) 

.80' 
i354) 

.84 
(354) 

.61" 
(347) 

.56 
(344) 



.90 
(103) 

.89 
(62) 

^2 
(99f 

.70^ 
(74> 

.99 

(52). 

.80 
(54) 

.88 
(75) 

, .52 
(104). 

.64 
(104) 

(105) 

.87 
(105) 

.37 
(102) 

.48 

(103) 



Numben in parenthews indicate sample sizes. 

Letters a, b, c, refer to significance levels for betyveeh-group comparisons of corr«)^ions: a indicates p < .05, b indicates p <^1, 
<nd c indicates p < .001 The significance of diffennces between correlations is based on a x' test on Fisher log transforrriations of 
the correlations. ' • . * ... 



The greater reliability for nonwhites stJinds in' 
direct contradiction to other studies and is 
internally contradictory ,>irfr"abiljty group 
results (below) but supported by the observed 
SES difference* (below). 

^me difference in reliability among the 
three ability groups occurred on 18 of the 27. 



continuous' variables '(Table_ 16); however, 
there w^re 36 significant differences overall. 
Of these, the lowest ability group was the 
least reliable 30 times, and the highest ability 
group was the least reliable only once (work- 
ing plans). This large number of differences 
oc(;urr^d despite a substantially smaller 
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RELIABIUTY FOR A8iUTY GROUPS: CONTINUOUS VARIABLES 



UMtiNliMtf 



D Mcriy tiow 



iiittrvww l|odt 

Abi/ity Groups 



AN Rispondtnts 

Ability Groups 



M 

i 



(r) ' 



SchoQl itttndanct 
School ^rformanct 
Datt of tmployment ' ' 
Ho^^i^Norfced/wetk 
N9. of dtpendents 
. Own income 
Spoust income 
Other income ^ 
Total income 
Self-esteem 

Consumer behavior 2 ' 
• Plans: Working 

Rans: Academic edacation 

* 

Rans: Military ^ 
Rans: Hoj^t^^ing 
Plans: Olh«r 
Woii compositt 1 
Work composite 2 



•(56) 

•.55» 
(18) 

.69"^ 

''.51' 
(33) 

.42' 
(54), 

.32' 
•(37) 

.83' 
(19) 

.66 
- (17) 

.29', 
(36l ' 



{n 



56) 



2B" 
(56) 

.75' 

(57) 



(57) 

.80' 
(57) 

.48' 
(57) 

.§7" 
t57) 



.49" 

m 





High 


Low 


Midaie 

Ir)' . 


nifn 


(r) 


(r) 




(r) 


J32 


53 


.82' 


j.OO 


Yoo 


4125) 


f61) 


(38) - 


. (41) 


(8) ; 


.71 


M 


-J7« 


50 


m 


.156) , 


(49) " 


' (6). 


. (19): 


(7) 


■ Ai ' 


^'J7 


598' 


50 


52 


(81) . 


(35) 


(22) 


' (29) 


(6) 




.73 


.71' 


.84 


■ ' 1.00 


(81) 


(37) 


T22) ' 


" (31) 




.77 


•92 


.93' 


50 


*1.08 


1126) . • 


(62) 


(37) 


(41) 


(8) 


51 ' 


J32 


.58' 


' 58 ' 


58 


(102)" 


(57) 


(32) 


(40) 


(7) 


J3S 


.91; 


.16' 


1.00 


1.00 


(51) 


(34) 


' (28) 


'(30) , 


(5) 


' .53 


.38 


.86' 


.26 - 


< ' 150 




(36) 


(26^ 


(29) 


(5) 


•90 . 


M 


55 


57- 


' 59 


(100) ' 

« 


(53) 


. (32) % 


(38), 


(7)- 


.64 " 


.77 


, .70 


.66- 


• .50 


(128) 


(62) 


(37) 


(41) 


'. (8> 


, :52 • 


.70 


.72 


- .64 


. .56 


(127) 


(62) 


, (37). 


t41) 


(8) 


.87 ' 


.73 


.55 


.74 


.74 




(67) 


(38) 


(41) 


(8) 


.80 


.80 


^ .82*^ 


■84 


1.00 


(128) 


162) 


(W 


' (41) 


(8) 


•^4 " 


1.00 


1.()0 


-r.tj(r 


1.00 


/I 0Q\ 






(AD 


10/ 


• Si», 


M 


53. 


54 


.66 ' 


•(128) 


(£2) 


f (38)^ 


(41) 


^ (8) 


.35 


,65 


I .47 


X 


X 


■U28) 


(82) 

4 


(38) 


*, (41) 


(8) 






^ — 








^ .77 


.77 


.53 


^ .37 


(123) 


' (62) 


(37) 


(41) 


(8) 



(r) 



Mddie 

<r) 



Hi|h 

(r) 




Numbers in pttrenthews indicate sample sizes. 

L«ten a, b, c, refer to sionificanceilevefs for between-group conriparisons of correlations: a indicates p < .06. b indicates p < .01, 
end c indicates p < .001. The Vigmfic^cepT differences between correletions is based on a test on Fwher log transformations of 
the oorVefationt. 

i[ indicatas 0 variartca«on one or both questipnnairef: ttius ncf correlation was computed. 
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REUAgHfrYFORSESGROrUK: CONTINttO] 



Ovcriptioi 



JIMMotft 

SES Groups 




* Data of employmtnl 
^^-^ HolfcMrkid/vmk 
No? of dapmlants 
Own ir^ome 

^ Other inconit 
Total Incomt 
Locus of comrol 



\ 



Consumer behavior 1 , 
rtans: Academic education 
Plans: Military 
Plans: Horr^making 
Plafa: Other 
'Work composite 1 
Work composites 
Worktfoals 







Hi|b 


Low 


MMdlt 


(r) 


(r) . 


(r) 


■ (r) 


(r) 




.51 


.84, 


i — r- 

38^ 


34 


m\ 


(102) 


(33) 


(31) 


(40) 


.80 




.80 


33= 




(64) 


«05) 


(33K 


(30) 


(45) . 


.79« 


.76 


32 


.86' 


39 , 


(SO) 


(168) 


(69) 


(48) ■ 


(59) J, 




31 


37 


37' 


.62.- 


176) 


(122) 


• (54) 


(45) 


^52) 


.89 


35 


36 


36' . 


.25 


(36) 


(70) 


(26) 


(36)- 


(43) 


.68« 


,32 


.29 


36^ 


.30 


(36) 


(60) 


^28) 


- 438) 


(39) 


.35"= 


(m) 


■ 34 


38'' 


34 


.80" 


(56) 


(43) ■ 


(54) 


.65 


.54 


.70 


.77 


(96) 


(159) 


(69) 


(49) 


(59j 


.61 


M 


.54 


.74* 


^68 


m- 


(160) 


(70) 


(40) 


(59) 


J3 




32 


.85' 


•81 


(96) 


(160) 


(70) 


(50) ■ 


(60) • 




.72 


.89 


1.0b 


1.00 


(96) 


(160) 
' .82 


(70) 


(50) 


im 


.85 . 


.80 


.86* 


35 


(96) 


(160) 


(70) 

r 

.65 


(50) 


(60) 


.22* 


.46 ' 


V8l'' 


.-48 


(96) 


^160) 


(70) 


.(50) 


(60) 


A2' 


.56 


.72 


.57 ■ 


.50 


(91) 


(159) 


(69) 


' (48), 


(59) 


.44 


.44 


.55 


.82" 


.62 


(90) • 


(158) 


(66) 


• .(49) 


(59) 


.59 


.64 


.73 


.88''- 


.59 


(97f 


> (161) 


(69) 


(49) 


(59) 



AI^Baspondeiitf^ 

' ^S Groups ^ I 




ftumbers tn parentheses indicate sampJe sizes« 

Letten a, b, c, refer to significance levels for between-group comparisons of correlationi: a indlcataiT p < j05. b indicates p < .01. 
acKl' c indicates p < .001 . The significance of differences between correiatibns iS based on a x* test on Fisher log transformations of 
the correlations. 

X irwticates 0 variance on one or both questionnaires; thuf no correlation was computed. . ; 
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sample size due to the lacjc of Ability data on * 
126 * subjects; ^and, in parti^lar, -significant 
differences can be noted among ability groups 
in the interview re^onse mode for as few £ts 
:32 regpoi^nts (e^., school perfoljiiance). 

^ P^i<i^^lipc^^x^ are a few eXceptions^J^ the 
genetal trend of reliability being ppsitively 
^associated with ability, it seem s reasonab le to* 
conclude that low ability persons do not 
provide data as reiiable_as that of middle ^or 
hi|^|abali^y persons. This trend e^ts across 
item^ characteristics ^d data collection pro- 

Icedures. ' . 

Among the mor^ criticsd^ differences are 
' the low reliabilities (for low ability persons) 
^for, sclroot perfonnance (r=,.49), hours 
worked per week (r - .56), and own income, 
spouse's income^ »d total income (r's of ;41, 
.24, and .38). .Taking thV data c611ect|oti pro- 
cedifte into account, mail- in^ questionnaire 
data for low ability persons is particularly 
unreliable forjiumb«r of dependents (r= .42,), 
own income (r = .32), total income ^r = .29), 
and consumer composite 2 (r = .25). In the 
' interview mode, low ability persons were 
unreliable on schopl performance (r = -.17) 
and spouse-'s income (r = .16). 

Table 17 provides data oli SES differences 
in reliability,. Like the preceding results on 
sex, ethnicity, and ability, there are many 
differences which do notform a readily inter- 
pretable picture. Most of the differences are 
interactive with data collection procedures— 
'sometimes with striking results (e.g., on own 
income, low SES persons are the least reliable 
in the mail mode, r= .24, but the most reli- 
•^ble in the intervievf mode, r = .97). Table 17 
, indicates a total of 30 significant differ- 
ences; 8 overaJ^v^ 9 m the mail-in mode, and 
13 in^he intemew mode. On^ two of the" 
eight overall differences (other income' and 
work composite 1 ) ate apparently independ- ' 
ent of. the data Collection procedure. Genen 
ally, .the least reliably group wgs the middle 
SESgrbup. 

Reliabilities below .50 are numerous and 
occur frequently on income data. Own 
income and total inconie are quite unreliable 
for the low §ES group overall and in the mail ' 
mode. These results may of course be related 
to the previously mentioned ability differ- 
enceslnXeliability. ^ 



^. Piscussion 

^ The vast array of differences in reliability 
associated with item and re'spondent charac- 
Eristics, data collection procedures, and inter- 
actions among the^ factors prohibits, any 
singular cpnclusion a^out the reliability of 
NL^ data. While the avdt^e item (of those 
analyzed) ir reasonably reliable (median reli^ 

' ability = .67) as measured by correlation 
coeffici^jnts for cdntinuous or didfotomous 
variables and by Cramer^s V for categOTical 
variables, the range is fairly broad. The high- 
est to||L sample reliability was..St2 (school 
att^n^^Ph the only reliability coefficient in 
the .90 's. By contjFtfst, three^ items had reli- 
ability indices bwow .50: .36 for other in- 
come, .41 for educational plans dtiier than 
ccrflege atid ,48 for "other" mii^llaneous^ 
plans. When respondent charactetiittics and 
data cO(llection\procedures are conVidered the 
range i4 mucb oreater: various subg£i9ups had 
reliabilities of J,00 but-'there were mitoy reli- 
abilit^ey^bek)w .SOT (the lowest observed testr 
retest cprrelation was -.17 for loW' fbility 
re^ond^nts on school performance collected 
by intense w). ^ . . - 



strictly on the jtbtal sample, fact- 
ually* oriented itpms were substantially more 
reliable than items dealing with expectations 
and self-evaluations. This fesult is highly con- 
sistent with previous studies of survey ques- 
tiqnnaire reliability (see review chapter) and 
stands as the best substantiated conclusion of 
Vthis study^ ^ • ^ 

* • 

1. ' ReliabHity as a Function 
of Dfita Collection Procedure 

Fairly clear differences also exist between 
the reliability of interview and jnail-in re- 
sponses. Interview data were, with only one 
exception, as reliable or more reliable than ^ 
mail-in data. The single exception was f0| 
spouse's income; however, this excwtip^^ • 

^ could well have been due to femaleis who^lljHle * 
not well informed'about their husbands' j^&n- 
ings but who could seek but aiurate (or c<^- 
sistent) results from their husbands ^Or^uie 
miil-in procedure. Also, numerous inter- 
actions with respondent characteristics qual- ^ 
ify the main results of interviews being mor§ 

' reliable than mail-solicitec|Klata. Despite these 
interactions, it seems^Sife to conchide that 
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the interview procedure ^nerally produces 
more reliable data than mful-jn procedure. 

2. Reliabitity as a Function of 
Respondent Characteristics 

. Reliability also vari^^WWth res?)ondent 
characteri8tics;Jiowev^e^, many of the differ- 
ences in reliability associated With respondent 
characltristic^ were qualified by interactions 
of respondent characteristics with data c ollec - 
tiWTprocedures. Since many of the inter- 
actions between re^ondent characteristics 
and 4stta collection procedures were not con- 
sistent across items, it seems necessary to con- 
chide that there is at least a three-way inter- 
action (respondent characteristics* by. data 
collection madfe by item content). ^ 

Differences in reliability between males 
and females exist but neither group was con- 
sistently more reliable than the other. Males 
were more reliable than female^ for items 
involving numerical judgpients (e^., income); 
otherwise females generaUy were more reli- 
able than males. When males and females were 
compared within a data. collection procedure, 
differences were more frequent but did not 
cajisistently favp^ either group. 

-The ethnic ^up comjiari^ons showed a 
tendency fofs^ nonwhites to be slightly more 
reliable than whites. The items„ favormg no;l-" 
Whites mvoh^eci factualiy^riented data (e.g., 
anticipated income, number of dependents, 
date of eipployment) while pxpse favoring 
whites Hfere more subjective m nature (e.g., 
self-esteeitt, work factors). There was no tend- 
ency -for the pattern of differences^ to be 
associated with data collection procedures.'. 
While it IS comforting that there was no con- 
sistent bias in reliability associated with 
ethnic /ra^cial groupings, this firylmg doek run 
counter to previous research aj»d* deserves 
further scrutiny. While te^-retest question- 
naire nonresponse was not associated at cop- ' 
ventional statistical levels (p < .05) with arry 
companton among demog^phic groups, there 
yfks a/tendency foV whites to have a higher 
retwn rate than nonwhites. If this trend has i 
been operating since base year and if it also - 
occurs at an jtem nonresponse level, the 
current findings could be attributed to differ- 
ent questionnaire-taking behaviors. That is, if 
unreliablfe nonwhite re^ondents tend to drop 
out at a greater rate than reliable\ nonwhite 



respondents' and whites in general, the current 
results could be artifactual. Only an evalua-. 
^on of questionnaire and item nonresponse 
>¥oUld provide the necessary data to resolve 
this. * ' o 

, The vast majority of items showed varia- 
tion in reliability as a function^ of ability. 
While there were ^ few minor exceptions (e^., 
date of employment and other Income in the 
interview mode), it seems safe to conclude 
that low ability persons provide less reliable 
data than middle or high ability respondents. 
Generally, the hi^ ability respondents w^e 
mqre reliable. . 

A large number of differences also, 
occurred among SES groups, but unlike the 
ability group differences the pattern' did not 
consistently favor any single SES level. Some 
items (e.g., dite of employment) favored the 
lowest SES groups, others (ejg., ^mber of 
dependents-interview mode) the middle SES 
group, but most 'favored the highest SES 
group. While there are numerous exceptions, 
< the overall Irend was for the highest SES 
group to be most reliable and for the ihiddle 
SES group to be least reliable. 

It should be apparent that the^ association 
^ of reliability with resp)ondent characteristics 
forms a complex and almost paradoxical 
pattern. The general trend is of the least reh- 
able respondents being low ability, middle 
€ES, and white and the most reliable t>eing 
higji ability, high SES, and tion white. The 
/"paradoxical nature of .these results is to be 
* found in the fact that nonwhites have lower 
ability scores and SES dn(fices than whites. 
Thus one would expect that if high ability 
and high^ SES persons were generally most 
feBable, so too would whites be morerebable 
than nonwhites. Unfortunately, the already ' 
smalf«&mple sizes prohibit any meaningful 
com|>arigon at a cross-classification l^vel (e.g., 
ethnicity iby tibility b^* S£S), particularly 
when cofttrolling for mode of data collection. 

3./ integration of Results ? 

On balance, it would appf ar that cpmp^%f 
multiway interactions are bpejrating amohg 
the demographic factors. The^e interactions 
are further cOmplicatedk by ^ihteractionS with 
data collection procedures an^^item character- 
istics (particularly the o^ectivity-subjectivity 
dimension). Despite t)^. existence of thesfe 



interactioM, there •are^ fairly stxotlr main' 
effects, most* of which are suppoi^ by 
previous research. These findings in order of 
strength of substantiation are: \ 

/ a. FactuaUy oriented itenos are morie reh- 
-Able than subjectively oriented ilems],_ 
—b* Interview collected data i^ more reli- 
able than'^mail- in data; ^ 

c. Low ability respondents are Icy reli- 
^ , able than middle or high ability re^ 
"*r y^^ ^ qx)ndents; ' . ' 

d. iMiddie §ES respondents ^re less feli- 
- able than^Jow ot high, SES respond- 
' ents; # 

e7 Females are more reliable than males ' 
on nonquantitative items; 

f. N on whites are more reliable than ' 
whites; 

g. Response categories wilt. an ambig- 
u6us referent (i.e.» **oth,er'*) are 
generally unreliable. 

4« Interpretation and . 
Implic^ions 

The above conclusions are, of course, 
qualified by the frecuient interactions and 
they need to be inl^igfc^d with-'caution due . 
to the unknown e,ffec^^ instnimeht and item 
nonre^nse biases. Generalization of these 
results to the ^ntire NLS data base also needs 
to be done with»care. While the reliability o$ 
the ay^be item included in the study was 
respfectiSe (.67), there waS a l6t of variation. 
This level of reliability cFearly indicates that 
the item or composite data art -not totaUy ^ 
reliable and for some purposes they are noi 



.sufficiently reliable. For example, the overall 
level of reliability is not sufficie^ntly high for 
path ^analyses emm using a^ liberal assumption 
that if the reliability is in the .9Q's analytic 
work .may proceed. Similarly, construct inter- 
pretations of correlations and regjre^ion 
^"^^^aMlyses and comparisons of effects among 
various niultiple Qlassification"grou|Js all need 
to^be Q^ne with caution. 'The failure to obtain 
significant, relationships J^twjeen dependent. 
variable£ amt4ndependent variables coidd be 
due to an actual absence of a relationship or 
to poor data quality. • . ~— ^ 

The existenceXpf .numerous and perhaps 
c om plex interactions among demogr^hic 
groups alone at mtk data collection proce- 
dures further complicates interpretation. For 
many dita analyses, only^a subset of the NLS 
sample is used. For exampie, the investigation 
• of ^ork activity and attitudes would generaUy 
involve more unreliable- respondents than 
would an investigatioiT of\postsecondary 
ed«ation_and reflated factors. Thus, even if a 
^ researcher used only those variaWs included 
"in this study » adequate estimates of reliability 
for structural i^deling might not b)e available 
if the subsarople did no^ correspond \o one of 
the*demographic subgroups indudecK in this 
study. \ , 

Generdlization to the entire NLS sample is 
also complicated^ by the higher than usual 
attrition rate for'the short form. There could 
be a furthfer confound also if/ the relationship 
between demographic groups and data cqUec- • 
tiOn procedures cjlffers for th4s sample -versus 
^e entire NLS sample. CJearl/, generaliza- 
^ns baseil solely on this study to the entire 
ffLS data base can only be provisionally and — 
cautiously offered. j 



V. IMPLICATIONS AND CONCLUSIONS 
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The review of available literature' Qn the 
' reliability of NLS type questions, respond- 

• ents, and ddta collection procedures generated 
findings which are generally consistent with 
those obtained in th^ reliability study. Ooejof 
the goals of this chapiter is to integrate the ""^ 
findings of the ^eliabillty^§tudy with the exist- 
ing literature so that the quality of NLS data, 
and survey rese^ch data in general, can bie 
better understbpd. Since a validity study was 
not earned out, a comparison of validity con- 
\^ siderations cannot be similarly offered. Con- 

'\sequently, generalizations about validity can • 
\)niy be made from previous research. The 
validity results generally are in agreement 

' with the- findings on reliability; however, 
some disci^epancies do exist and require reso- 
fution. 

^ A. Reliability and Validity - 
as a Function of Item 
Characteristics 

The literature and reliability study are un- 
equivocaJly consistent m the finding that 
copteipporaiieous, objective, factually on- ' 
entecT item^ are nrore reliable than subjective,- 

^temporally remote, or ambiguous items. In 
particular, the reliability study results indi- 
cated that the reliability of contemporaneous 

•factually based items was in the^'range 
(.67 -.92) and the remaining items were in 
the range (.36 - 86} While the level of reli- 
ability was perhaps lower than that, o43tained 
by van Es and Wilkening (1970), Boriich and 
Creager il912L or Kyaser and Summers 
(1973), tbe dOTSistency of the findings iV un- 
ambiguous. . ' ^ . ^ 

Boruch and Creager (1972) and van Es 
and Wilkening (1970) also found that items 
with a feiture or retrospective orientation 
were l^ss relial^le than contemporaneous 
items. The reliability study mdicated similar 
findings, although a comparison on this basis 
was limited. Other dimensions of itena#harac- 
teristics generally did not produce consistent 
diffei^ences, but the limited sampling of items 
in the reliability study could be responsible. 
rom the literature, however, even factually 
iteps differ in reliability depending 
rtance (Astin, 1965), with person- 
terns being more reliable. The 



well detailed tables of Boruch and Creiage^ 
(1972) also indicate \that personaUy sensitive 
it^ms (e.g., income) \are less reliable than 
other factu,ally onent^ items. In the reli- 
ability study the income items were not 
strictly factusd smce theyv required earnings 
the curreni year; however, these itexr^ 
were generally of low reliability. 

The validity results are similarly consist- 
ent. Both .Walsh (1&67 and 196^) and Kyaser 
and Summei;s (1973) found that^ighly fact- 
ually oriented iteois were r^ore valjd than less 
factually oriented items. Of particular interest 
are the Kyaser ^d Summers results on m- 
come data; even corrected for attenuation due 
to unreliability, proxy reports of income were 
highly mvalid. 

The attitudinal and psychological vari- 
ables included in the sample were typically of 
^ moderate reliability. Most of these variables, 
either as items or composites^ have no prior 
history; hence 'their construct or predjctive 
validity is unknown. Although the results of 
the study by Conger, Peng, 2UTd Dunteman * 
(1976) indicated a reasonable pattern of rela- 
tionships for the self-esteem, locus of control, 
and work, community, and family life-goal 
orientations, the relationships were generally 
weak. -Reviews of the validity of even highly 
refined personality and psych'olo^cal meas- 
ures produce a similar result Tcf. F«ke, 1974; 
or Wiggins, 1972). 

Baised on the differences in Reliability and 
accuracy or construct validity as a function of 
item conterrt, research involving combinations 
o4^ntent needs to done cautiously. Path 
analyses or structural models with incorrectly 
^sumed reliability levels would generally 
produce erroneous conclusions about the 
relai^iVe importance of these different kinds of 
variables. Even simple regression studies m- 
volving\statements about constructs would a 
j prion \e more likely to conclude *that 
factually oriented constructs are more impor- 
tant thait k^bjectively based constructs; hov^- 
ever, one cbuld probably trust results which 
. ^ indicated th^ opposite pattern (e.g., Colema^ 
~^et-fll. (1%6)\ who found locus of control to 
be the most important predictor of college 
'aChievement\ among mmonty J^irsons)^ 



' llesearch f ocus^ig on strictly emj^irical rela- 
tionships voOld, howevef, not be subject to 
the same prabjems. 



Aeli«bi|ity and^ Validity as a 
/ Function of Data Gdtection 
Procedures 



Data/coUection procedures have-not beeoi 
exhaust^ely ^udie^ as they bear on validity 
TjtcKr^liabili^. The prime studies by ^alsh 
<^967, 1968), and CanneU and. Fowler (1963) 
-end the review- by BorUs (1970) indicate that 
neither approach is consistently superior. The 
B^rus review and the CanneU and Fowler 
study do, however, indicate some important 
irilefacttohs. In particiilarrTilgH ability and 
hi0i SES persons are less influenced by data . 
collection procedures than low ability or low 
SES persons. The latter groups are more 
co6perative and produce more accurate or 
valid data in the interview proce^w. 

Both reseatohers alsb found a content by 
data coUection procedure interaction. That is, 
question^ which could be answered by con- 
sulting re<:otds are more accurately^ answered 
in a mail-in procedure. 

The r^lts of the reliability study indi- • 
cated that' the irrterview procedure generally; 
produced more rehable results with one major 
exception: the reporting of the spouses m- 
comeV On this variable, however, the, discrep- 
ancy was resolved by^ noting that the lower ' 
reliability m' the interview procedure could be 
attributed to women.'In the mail-in approach, 
males and females were equally rehable and 
were not Afferent from males who were mter- 
viewed. Apparently males need not consult 
records in reporting»the wife's incoijae but the 
females may have consulted theu" husbanS or 
records^ in sporting the ht^and's income. 



\ This nuxed„ state of affairs means that, 
were is no smguiarly best prtstcedure. forN^ 
c^lecting^ reliable and valid si^rvey oata. later 
vieWs woidd lose information on\^actual 
arcnhral data and mail-in questionnaires Woqld 
lose information ort other variables. Other 
consideratipps^ such as response rates and cost 
should\perhips take precedence, particularly 
if the r^sponfdents are heterogeneous on abU-\ 
ityandSES. ^ | 



C. Reliat>ility and Validity as a 
Function^f Respondent 
Characteristics. 

Pew of the studies reviewed locked \di 
rectly at reliability as.a fun^rtSW of respond- 
ent characteristics; however, most of the 
studies on validity did consider' this as a 
factor The validity studies indicated that race 
JiLan ijnpcfftant variable, witlf blacks pioVding 
less accurate information than whites (BOrus 
and Nestel, 1971; Kerckhoff, Mason; sind 
Poss, 1973; and Cohen and Orum, 197?). 
Also, hi^ SES respondents were found to be 
more accurate than low SE& respondents 
(Bonis and Nestel, 1971; Cohen and Orum, 
1972;and Walsh' and Burkhold,^1970). 

"ioriich and Creager (197^) found no 
male-female differences m validiiy and Cohen 
and (bnm (1972) found differences, but 
neither group was consistent!^ superior. 
Ability wa;^ not directly investigj^ted; how- 
ever, persons with high obtained>grades or 
higher educational levels produced more valid 
data than their counterparts (Boruch and 
Creager, 1972; and Bonis and Nestel, 1971). 

The reliability study had results generally 
agreement with the validity review with 
^ne major ej^ception: thcrole of irac^. The 
'validity stud^ consist^tly demonstrated^ 
t^at blacks provided less valid data than 
\j;rhites; however, the reliability study indi- 
cjates a balanced set of difference's with a 
tiendency for nonwhifes^to be mor^ rehable 
than wjiites. Unfortunately, possible problems 
in najnresponse rateSWn the reliability l^tudy ity 
/particular or in the sequential loss m tespon* 
eftts over time couM acoouijtVor this discrep- 
ancy. Other alternatives are also po$sibJe:^ the 
validity studies might have been biased in 
their critenon or san^ple^ or, while ©lacks 
produce less valid data, e'rror^in response 
might he consistent over tini^. No"d(efmitive 
state*ment can be offered at ih^ tinrt^e; now* 
" ever, a careful st^dy of tnis problem tsleaijy is 
warranted. ^ 1 * c \ ^ 

The remaining rela(ti(bnships between \re-, 
spondent characterist^ifal and reliab^ty \or 
validity are eoosister^t: TTo clp^ edge exists 
for either males females, but a. trend e\,ist 
of males producing higher quality data"^^ 
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financier oi* numerical questions. High ability 
and high SES respondents are- substantially 
more reliable and to a lesser extent mirr^ 
accurate than lower ability or lower SES 
^^^^^spondents. 

These differences in reliability and valid- 
ity as a function of race, sex, SES; and ability ^ 
can have profound Consequences for research. 
In particular, generalizing results across popii-^ 
lationf differing on respOT^nt~characteristics , 
-smld be highly problematic. One could not, 
for example, make reasonable estimates of 
measurement errore for structural modeling 
purposes if the r^iapility estimates came from 
\a population differiiig in ability level or SES. 
^imilariy, the path coefficwnts of causal 
' models could well "vary ^vfith respondent 
characteristics. In short, demograpWc vari- 
Ifles nee4 to be considered not only as con- 
^1 variables but also hs modesator variables. 
^ \ . 

Reliability and Validity as a 
'unction of Interactions Among 

1, Data Collection, and ^ 
^ei{]^ndent Characteristics ^ 

e abqve discussion has ^nerally 
focused on main effects associated with^tem, 
data collection, and respondent chara^er- 
istics. The literature review ^nd the reliabilftv 
study both indicate that th^ factors int^act.\ 




For ^example, the reliability study indicatQii 
that females unreliably report spouse's in- 
come in an interview but are as r6liat:>le as. ^ 
hiaks in the mail-in procedure. Ift a similar 
fashioji, CanneU and f^owler (1963) found 
that msdl-in questionnaires produce more 
valic^ data than- interviews if records can be j 
cohsvilted. The existence of such interactioii| / 
not <^ly requires that the main effects nem\ 
to^-^\qualif^, but also indicates that thF>^ 
design of kurveys and analyses based on •sur- / 
vey data should carefully consider the^j^ ' 
content^ data coUection procedure, and re- ' 
spon^ient population. If the survey is directed 
primarily at hi^ ability respondents^ ^ th,e 
method is proba!t>ly inreleyant; however, if the" 
respondent population iy^oi low abifity, intai^^ 
view prcrcedures would pe more apj!)ropriate— 
unless the content emphasized data for which 
records could be consulted. » " 

Path analyses can apparently be safely 
undertaken with factually oriented data, 
(excluding iilcomel on Kigh ability or high 
SES respondents, /i)ut otherwise structural 
modeling with eftor of measurement esti- 
mates based on /a similar population is re- 
quired. Overall, ^e safest approach would be 
to carry out i^elia'bility and .validity pilot 
studies prior iq( the main survey/ Only in this 
way could th^ most appropri^ adjustments 
be made. / 
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RESEARCH TRIANGLE [NSTITUTE 



RCS£ARGH TRIANGLE PAWK; NORTH CAROLINA 27709 t I' 



POST OFFICE BOX 12194 ^{J^ ^ 



pe&r Follow^p Participant^-". 

' We appreciate your completing the sec6nd follow-up questionnaire for the 

- National Longitudinal Study of the High School Glass of 19 72-. Your 
cooperation greatly helps in the continuinjg igffort to collect information 

; for planning better prt)grams to enhance work and educational activities 
^\ of young people like yourself. ' ^ 4 > 

We are always trying to improve the qiSestionnaire . One ^hing we wonder 
about Is whether a' question has -the same meaning to a person when asked 
I at different times. Jo determine this, we have selected a few questions 
from the second tollow-up questionnaire which you have already completed, 
and we are asking you to an^er them again. The results of this study 
will- Kelp us imprcive fut^|^e. questionnaires. ] 

Please read care f)ilfy each question in the short questionnaire. It is 
important that' you follow the directions for responding. ^Sometimes you 
are asked to fill in a blank — in these cases, simply write' your respot 
Where you are asked to circle a number, make a heavy circle. Here is 
. example: 

Did yov compkt* high school? '* f 

^ ' \ ^ (Circio ont.) 

No. still in high school ^ ' \ \ 

' ' *No, left high school without completing 2 

' ^ - ♦ Ye^ graduated ' ^ * Q) 

The eIRiire questionnaire will take only a' few mlnuflfrof your ti^. When 
^ yon complete the questionnaire, please seal it in ^Cpostpaid envelope 
provided and return it ^ff^ 

OPERATION FOLLOW UP * 
RoM«rch Tri^k liUtitutt 
^ Pott Offict Box 1203* - 

. J^soardi Trianglt Park, North CMrolii>o 2770t 

— Thank you again for your help. 



Sincer 



Davis . * 



•FTl Project Director 
^AD:fh ' ^ 
Enclosure " 
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American Indian 

Black or^Afro-Annencan or*Ne^ 

* Mdcican-American or Chicano 

Puerto d^ican 

^Other Latin-American origin 
Oriental or Asian- American 

* White or (Caucasian . 
-Uxher ^ . . 



(Orclt ont.). 

, .1 ^ 
. 2 
3 
4 

6 

, 7 
8 



Old ypu atftnd tcHp«l in fhm fint ol October im? 

No . r 1 GOTOQ.5- 

Yes . 2 GOTOQ 3' 



WM kmd^ictiMl Is this? 

* ' (OrcU 

Vocational, trade, business, 
or other career training 

^hool 1 

Junior or community 
^ ' "College (two-year) 2 
Four-year college or univer- 
. sity . ,3 

(Xher (descnbe f j ' 

) 4 



WInch.ol Hit following host doscnbos how Well you havo done in all ol your courstwoiic or program from Octobor 
lf73 through Octobor If your schooKs) or progr«m(s) do not vso loftor grades, ploato choosa the lottor 

grade mH^mos closost to describing your progrtss. 



Mostly A . 

About half A and half B 
Viostly B 

About half B and half C 
Mostly C 

About half C and half 
Mostl/D or below 



(tircle i 

^ 1 
2 
3 
4. 
5 
6 
7 



i:) 



1 



WIro you working during fho first woob off Ocfbor IW? 



No . 
Yes. full-time , 
Yes, part-time , 



GOTOQ 9 
GO TO Q. 6 



PI#«M dMcrllit bt«iw tht job yov l^d during tht fint w—k »f Octobtr 1f74. i tf you htid th*n out job at 
that Hm«, dMcnbt th«' om at which you >S^iic*^ 

a F<«r whom did you worlC^'dSlamc of company, business organization, or other employer) ^ 

(Write in) ' . Cj " — 

^ — "Y ■ f r * — r- • ^ : — 

b What kind of business or industry was this'' (For example, refail shoe sto^e. re^atjrant. etc ) ' ^ 

(Write in) — ' - \ ^ . ^ . 

c What kind»of job or occup^on did you have in this business Or industry'' (For^xample. salesperson. _ 
waitress, secretarx. etc ) ^ ^ - ^ — - 
TWriie in ) . ^ --^ \ [ 

d What N^ere your m^st frequent activities or duties on this job? -(For example. sell\ng shoes, waiting on tables, 
tvpm^nd fihng etc ) . J* \ ' i 
« U rite m » " ~ _ ^ . [ ^ ^ 

e Were \pi* — . ~ ' , 



(Circlaona.) 



An employee of a PRIVATE company, bank, business, school, or individual working for 
• wages, salary, or commission?^ , . . 

^ GOVERNMENT employee (Federal. State, county, or local institution or school) 
Self-entployed m your OWN business, professional practice, or farm 
Working WITHOUT PAY in family business or farm? 

f. When did you start workmg at this job'' X ^ (month) (year) 

g Are you currently working at this job'' * — 

Yes ' • r . , ' ' ' ^ 
No 2 Date left (month) [ .(year) 



How I'nany^houi^ dl^you usually work at thti jpb 



in mm avarago wtok? 



Hours per week 



■/ 



What was^r marital »tu». of tha fti^t laraak .of Odobof 1y74^ 

fOrcIt ( 

Never mapried. but plan to be marned within tHfe next 12 
' . ojonths . . * f * 1 

Never married, and don't plan to be marcued within the next 
* 12inonths ' 2 

t Divorced widowed, separat^ ^ , *2 

"4 



Marned 
4 



Not includiftg ^^nsrw^H, how many ponont wort 
d ap an dawt upon YOt^ for nrtoro ttian onr HaH of 
tlwir financial Support as of ttit firtt woofc of 
Oclobor W4. ^ • 



(Circlaona.) 

2 3 4 or more* 



7 



7^ 



W. Wk^ if H» btft tflimat* of your ificom«^Mor« taxvs fir ALL OF W^f If you aro mar^ includo your 
amoMnt, or if you wiJlroctiyo no incomo from a tourcOK^ng lf74. writo m tht wort! "nono ". 

^ \ Amount Will Rocoivo ' 



Your 0^ wages, salaries, commissions, and net income from a businesi 
or farm . . ^ ^ 

' Your spouse s (husband or wife) wages, salaries, commissions. anH net in- 
come from a business or farm 

All other income you and your spouse will receive"! include interest 

dividends, rental property income, public assistance, unemployment 
, compensation. caslTgiTts scholarships fellowship^ ttc ) 



4 



tOTAL INCOMK YOU AND YOUR SPOUSE WILL RECEIVE 

'4 



I. How do you fool 



•bout ooch of ttio following slattmonta? 



a I take a positive attitude toward myself 

b Gpod luck IS more important than hard 
work for success 

c I feel I am^ person of worth, on an e^l 
plane with otherfs 

d I am able to dy things as well as nrnst 
other people 

e Every time I try to get ahe*. something 

or soipebody stops me 
f Planning only makes a person unhappy 

since plans hardly ever work out anyway 
People who accept their condition in life are 

happier than tliose who try to change things 
On the whole. Vm satisfied with myself 



g 



AgrM 

Striigly 

1 

1 . 



(Circle ono ^mbor on ooch lint, ) 
Oi$«9ro« 



2 

2^ 

2 

2 

2 

2 

2 

2 



Di i ofr w 

3 

3 

3 

" 3 
3 
3 

3 , 
3 



Str^aly 



No 
Optwon 

5 " 
• 5 

5 " 

5 

5 

5 
5 



Whot ways do you asturo younoH of a good buy for yo^ monoy? 



a I compare pnces and label information of similar products or services 
b I return merchandise that is unsatisfactorv/^o the store where I 
bought It ^ / . 

c I rely on brands or companies I knowyu even if they cost more ^ 
d I follow leads in articles from ^umer" Heports. Changing Times or 
other such magazines ^^^r -^-^ ^ 

e I check a company's reputation with the Bette^BuMness Bureau or 
consumer protection agency before agreeing to ai^xpensive 
service or repair \ 

f I wnte to the manufacturer about the quality of the produchf I'm 
unsatisfied . ^ 



<Orcl« ono number on iMi lint.) 

I 2 



^ 1 



4/ 
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13^ Wtiaf dp yoM txptcf tp b» doing in OcHbr ms? 



IS. 




Working for pay at a iflf time or part-time job ^^f- 
Taking|cadeinif courses m a two- wlour-year co4i^™.^,.^^^ 
Takin^ocatiorteri or technical courses^at any kind df/l^tK^l 
or coltegff (for example, vocational, trade, biisHieis, or^ ^ 
other career training school) 3 

Ortacti^iftjutyinthe Armed Forces <or service apademy) ..... ^ 

) 6 



asapplyj 



cti^Jut 
emfflfer 



Homer 
"Other ^describe' 



iU Hiiiigt stand now, how far in school do you think you actually wUI got? 



High school only 
Vc^jonal. trade, or 
business school 

College program 



Less4^i^ years 
. T w years or more ' 
''Some college (including two-ye 
^j^i^hed college (f^ or five-year degree) 
^^aster's degree or equivalent 
*S D . M IX* 01^ equivalent . ^ 



(Grcloi 

... M 

2 

... 3 
4 
5 
6 
7 



How xmpnfiw^ is oach of tho following factori in dotormtmng tt»o kind of work you*pUn to bt doing for mott^of 
your life? ^ - 




d 

f. 
h 



Previous work -experience in the are^^ 
Relative or fnend in the sam^ line of work 
Job openings available in the occupation v • • 

l^ork matches a hobby invest of mine , 
Good income to start or within a ?ew years 
Job s^unty and pennanence 
p Work that seems important and interesting to nr>e 
Freedom to make my own decisions , 
Opportunity for promotion and advancem/nt in the long run 
Meeting and working with sociable, fnendly peoplfe 



U. How important is each of tht following to you in your lift? 



a. 

b. 

c 

d 

e 

f 

g 

h 

1 , 

J 
k 



Being successful in my line of work 



Having lots of money 
Havin^strong fnendships 
Being able to find steady ^work 
Being a leader in my community 

Being able to give myxhildren better opportunities than I've had 

Living close to parents and relatives 

Getting away from this areii of the cour)try \ 

Working to corr^ social and economic inequalities . . 

Having leisure time to enjoy my own interests 

Having a good education ' ; ^ 



> (arclool 


10 number of 


\ each lifw.) 


. ' Vory 




. Not 


Impo^ant 


Important 


linpa^ant 


. ' ...1 .'. 


... 2.. 


. . ' .3 


. -/ L. • 


...2 


, .3 


I ... 


. 2 


.. .3 


1 


2 ' 


.3 


I 


2 , 


3 


.r-^' 1 


2 . 


3 


.1 : 


2 


. 3 


1 


2.. . 


3' 


1 


2x 


. .3 


' . 1 


2 . . 


... . 3 








(Circloof* 


% fNiiiiboi' on 


each Hno. ) 


V«ry 


Sonwwtiat 


' Not 


Important 


In^portant 


- Important 


1 


2 


3 


life „ 1 


2 • 


3 


1 . 


2 


3 



3 
3 
3 
3 
3 
3 
3 
3 
3 
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17. WkM kind wtHrirHt you U d»ifig wHmi you «rt 3^ yMft (ttrcto Hw m Hiit e«f|iM clMtt !• what y«i 



1 



a. ClI^ICAL such as bank^eller. bookkeeper, secretory, typist mail earner, ticket ageflt , . 
' b. -piAFTSB«AN such as baker, automobile mechanic, machinist, painter, plumber, telephone m 

/" staller. carpenter ^ . .^ ' 2 

cj FARMER. FARM MANAGER : 3 

A HOMEMAKERORJibuSEWlFEONLY 4 

e. LABORER such as construction worker .car washer, sanitary worker, farm laborer > 5 

f. MANAGER. ADMINISTRATOR such as sales manlier, office manager, school admmistrator, 

buyer, re^aurant manager, government official ... " . \,j , 6 

g. MILrTARYsuchascareerofficer. enlisted man or wonrian in the Armed Forces 7 

h. OPERATIVE such as meat cuttef; assembler, machine operator, welder, taxicab. bus. or truck 

. driver, gas station attendant . • 

1 PROFESSIONAL such as accountant, artist, registered nurse. engineeL libranan. writer. 

social wor)^r. actor, actress, athlete, pohtician, but not includmgjSlic school teacher 

f} PROFESSIONAL such as clergynum. dentist, physician, llawyer. scientist, college teacher 

k, PROPRIETOR OR OWNER such as bwner of a smalf business, contractor, restaurant own^- 

^ I PROTECTIVE SERVICE such as detective, poliqe officeror guard, sheriff, fire fighter . 12 

m SALES such as salesperson, advertising or insurance agent, real estate broker . . .13 

n. SCHOOL TEACHER such as elem^tary or secondary 14 

0 SERVICE such as barber, beautician, practical nurse, pnvate household worker, janitor, waiter ... 15 

p TECHNICAL such ^draftsman, medical ot dental technician, computer programmer ... 16 

fl. NOT WORKING . * » / 

. ■■- _ 

la VVhtndidyoucomp|«t«thiiqii«ftk>niuirt7 

— (rtionth)^ (day) , (yeai) 
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^ rHAHK YOU PGR YO|JR COOPERATION 
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THIS INFORMATION WILL BE KEPT IN STRICT CONFIDENCE AND WILL BE USED ONLY FOR PUTURi 
FOLLOW UPS IN THE NATIONAL LONGITUDINAL STUDY OF THE HIGH SCHOOL CLASS OF 1f72 ' 
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